Finding and collating data can be incredibly time consuming, taking up to 70 percent of an E&P professional’s time. With 10 TB of data being created per well per day, the challenge is not getting any smaller. If we as an industry are to make the most of our data, we need to put that data up front and center. It needs to be liberated from the applications and transitioned to Open Subsurface Data Universe (OSDU).
Given the sheer volume of E&P data and the need to continuously enhance its quality, the ingestion process into OSDU needs to be high throughput, low latency and self-cleaning. This Enterprise Data Management can sound like a daunting prospect. But it doesn’t have to be.
With intelligent workflows at your disposal, data can be subject to rigorous quality control before being transitioned efficiently and effectively on to OSDU, and in doing so creating a robust ingestion pipeline.
Over half the battle is getting the data organized and loaded. With that in mind, Halliburton Landmark made a commitment to OSDU to ensure that all Landmark products and services would be OSDU compliant.
DecisionSpace® 365 software as a service on OSDU provides an efficient and effective means of ingesting large quantities of data from a variety of sources. This has been achieved in conjunction with our partners, by combining Landmark’s deep expertise in E&P data management and our partners cloud technologies to develop new innovative workflows which are now available publicly with the R3 commercial release of OSDU. Once the data is loaded, DecisionSpace 365 cloud applications provide modular, open, and plug and play solutions, with intelligent workflows to drive efficiency and provide data driven insights.
To prepare and enrich log data for ingestion into OSDU Landmark has contributed new architectural additions to OSDU to support new binary storage capabilities to enable performant access to metadata, file data, and the high precision measurement data for log curves.
Files are uploaded using a simple self-service interface. Machine learning is used to predict metadata based on previous results and runs quality checks for completeness, validity, and duplication. This helps ensure that data of good or known quality is available to users in petrotechnical applications including AI/ML models.
Once prepared, the data is ready to be submitted into OSDU as the system of record.
Data can either be ingested directly into OSDU or can be registered from external systems such as Engineer’s Data Model™ and OpenWorks® software. This means you can continue working with the applications you know and love such as Digital Well Program®, a DecisionSpace 365 cloud application, as well as simultaneously integrating with third-party applications for end-to-end workflows
With a rich set of data available in OSDU you can start utilizing that data to create new value-adding capabilities. Data can be queried via the OSDU Search APIs for binary and drilling data via a Jupyter notebook to experiment and build a new AI/ML model.
The OSDU master records can be queried to retrieve the required data and associated registered targets. With the retrieved data you can utilize delivery API’s to retrieve the URL and query for the full data. This ensures you’re getting the most accurate, updated data which can be quickly visualized in Jupyter notebook to build the models, making the data accessible to anybody, anywhere in any application.
Since 2019, Landmark’s cloud-native microservices and workflows have been and continue to be OSDU compliant. We’ve made an OSDU instance available publicly in our Open Earth Community and created an OSDU reference implementation, which we continue to optimize for performance and scale, and contribute changes and enhancements back to OSDU.
The workflows highlighted above are just a glimpse of a much more comprehensive solution for borehole, seismic, drilling, and subsurface data that will help enable you to transition your data and applications on top of OSDU while enabling business continuity for your users.
Expert: Chandra Yeleshwarapu | Senior Director, Products, Customer Experience, And Business Development