Javier Lagares is a Principal Knowledge Engineer at HP, the place he leads the event of data-driven options for the 3D printing enterprise. With a powerful background in knowledge engineering and structure, Javier is captivated with leveraging knowledge to drive enterprise outcomes and enhance buyer expertise.
As corporations more and more depend on knowledge to drive decision-making throughout all industries, HP’s 3D Print division is main the cost with a transformative initiative: sharing close to real-time tools telemetry knowledge with their clients that use 3D Printers as a part of their very own manufacturing course of. This knowledge sharing functionality permits HP’s clients to watch the efficiency and utilization of their leased tools and proactively take enterprise or upkeep actions utilizing knowledge insights. By utilizing Delta Sharing and different Databricks options like Unity Catalog, Mosaic AI and AI/BI dashboards, HP has constructed a safe and scalable resolution that gives complete insights into machine efficiency, materials utilization, and upkeep wants.
Empowering clients with knowledge
HP is dedicated to offering its clients with detailed, actionable insights into their tools. This initiative permits clients to view and analyze their printers’ telemetry knowledge, making it attainable to optimize their operations, cut back downtime, and acquire a transparent understanding of useful resource utilization to cut back prices.
Led by Javier Lagares – principal knowledge engineer, HP carried out a complete knowledge resolution on the Databricks Knowledge Intelligence Platform. This resolution captures telemetry knowledge from an array of sensors embedded in HP’s tools, and combines it with knowledge from a number of different units together with not solely printers, but additionally processing stations (which deal with duties that put together a 3D printed object for its ultimate use), unpacking stations (which unpack components, take away powder, and recycles supplies post-3D printing), curing stations (which harden and stabilize components after printing), amongst others. These sensors accumulate important data for every processing station, comparable to the roles processed and supplies used within the jobs, amongst a number of different knowledge factors. This knowledge basically kinds the “DNA” of every printer, permitting HP and its clients to realize invaluable insights into your entire print job lifecycle.
Architecting the Answer with Databricks
HP’s resolution is constructed on Databricks’ medallion structure, which is designed to allow scalable knowledge ingestion, transformation, and sharing; and contains 4 fundamental levels:
- Touchdown Layer: The touchdown layer serves as a communication layer with the units. The info on this layer is processed precisely as soon as. If knowledge from this layer shouldn’t be acknowledged as obtained by HP, a preemptive course of kicks in to cease associated units.
- Bronze Layer: The bronze layer unpacks the knowledge from the touchdown layer into a number of tables for additional consumption.
- Silver Layer: On this stage, the uncooked telemetry knowledge is cleansed, filtered, and remodeled for usability. The info is ready by making use of transformations to take away redundancies, appropriate anomalies, and format it right into a extra usable construction.
- Gold Layer: The Gold layer affords the curated datasets, that are then shared with HP’s clients through Delta Sharing, enabling them to research and make the most of this high-value knowledge immediately.
The medallion structure permits HP to course of and share telemetry knowledge making certain that clients at all times have up-to-date data at their disposal.
Sharing Knowledge Securely with Delta Sharing
As soon as the telemetry knowledge has been processed, HP shares it with clients utilizing Databricks’ Delta Sharing open sharing capabilities (D2O). These options enable HP’s clients to eat the info; regardless of whether or not they use Databricks or not. The recipients can immediately hook up with shared knowledge utilizing Delta Sharing connectors that assist varied techniques like pandas, Tableau, Energy BI, Apache Spark, Rust, or others that assist the open protocol. When a buyer is registered, they obtain an HP endpoint, which they’ll use to entry datasets utilizing any Delta Sharing connectors or APIs.
To make the method seamless for patrons, HP offers complete documentation for every knowledge asset, detailing the right way to eat the info. HP additionally contains pattern code that leverages D2O libraries to assist clients rapidly combine the info into their pipelines, in addition to a pre-built PowerBI dashboard that reads knowledge by the Delta Sharing connector and clients can use if they like to not create their very own visualizations. This degree of assist ensures that HP’s clients can simply start utilizing and analyzing their telemetry knowledge with none prior experience in Delta Sharing or the underlying knowledge structure.
Predictive Upkeep by Mosaic AI
Probably the most impactful options of HP’s resolution is the inclusion of predictive upkeep alerts. Utilizing machine studying fashions that leverage Mosaic AI capabilities, HP can precisely predict upkeep wants primarily based on telemetry knowledge. These predictive upkeep alerts are offered to HP’s Buyer assist to assist them present a greater buyer expertise by reaching out to clients to schedule tools servicing making certain their printers stay in optimum working situation.
These machine studying fashions analyze telemetry knowledge patterns, which might point out early indicators of potential points. By offering these alerts, HP enhances buyer satisfaction by permitting clients to plan forward and cut back interruptions to their manufacturing processes.
Enhanced Knowledge Safety with Unity Catalog and ApiGee
With buyer knowledge privateness and knowledge safety being prime priorities, HP leverages Unity Catalog to implement knowledge governance and apply buyer segmentation. Unity Catalog permits HP to regulate entry to knowledge property at a granular degree, permitting them to segregate knowledge for every buyer and apply customized knowledge entry insurance policies primarily based on particular contract phrases. This dynamic mannequin ensures that every buyer solely has entry to their very own knowledge.
Moreover, HP has carried out ApiGee to additional improve knowledge safety. ApiGee acts as a masking layer for all HP inside URLs, making the data-sharing course of 100% clear to clients. The usage of ApiGee ensures that clients solely work together with safe endpoints, adhering to HP’s knowledge safety framework.
Monitoring and Enhancing Buyer Expertise with AI/BI Dashboards
HP additionally leverages Databricks AI/BI dashboards to watch the utilization of its telemetry resolution. These dashboards present metrics on knowledge entry frequency, geographic location, and the variety of customers accessing the info, amongst different attention-grabbing knowledge factors, giving HP’s staff a complete view of how their resolution is definitely used.
This utilization knowledge permits HP to grasp buyer consumption patterns and determine areas for enchancment. For instance, if HP notices a selected function that’s incessantly accessed, they could prioritize enhancements to that function in future product iterations. Moreover, the AI/BI dashboards supply insights into geographic tendencies, enabling HP to tailor their assist and repair choices to fulfill regional buyer wants.
Conclusion
The flexibility to entry and analyze telemetry knowledge in close to real-time is a game-changer for 3D printing. HP’s resolution not solely affords invaluable insights into machine efficiency and the 3D half era course of but additionally permits clients to take a proactive strategy to tools upkeep, maximizing the worth of their leased 3D printers. By persevering with to put money into superior data-sharing applied sciences, HP is setting the usual for data-driven innovation within the 3D printing trade.
As HP continues to refine and develop its data-sharing capabilities, they’re a transparent chief in a future the place knowledge insights grow to be integral to industrial processes and buyer engagement. With every new enhancement, HP demonstrates its dedication to leveraging know-how for buyer empowerment, setting a excessive bar for knowledge sharing and machine monitoring.