Launching an Inner Knowledge Market with Atlan
The Energetic Metadata Pioneers sequence options Atlan clients who’ve not too long ago accomplished a radical analysis of the Energetic Metadata Administration market. Paying ahead what you’ve discovered to the subsequent information chief is the true spirit of the Atlan group! So, they’re right here to share their hard-earned perspective on an evolving market, what makes up their trendy information stack, revolutionary use instances for metadata, and extra.
On this installment of the sequence, we meet Cristina Perez Martinez, Knowledge Engineer and Architect, and Ezequiel Barbero, Market & Enterprise Intelligence Supervisor at Telefónica Tech, who share how a contemporary information cataloging expertise and column-level lineage will assist a broad imaginative and prescient for information democratization.
This interview has been edited for brevity and readability.
Might you inform us a bit about your self, your background, and what drew you to Knowledge & Analytics?
Ezequiel Barbero:
I’ve obtained a Masters in Huge Knowledge and have labored in Knowledge & Analytics since 2002. I began at Telefónica in Argentina with the BI Knowledge Staff engaged on ETLs based mostly in SQL. Then I labored in Knowledge Engineering serving to with Knowledge Science, working with the top of that staff in Argentina.
In 2019, I got here to Spain to work with their Knowledge Science staff on Advertising Intelligence, and in 2021 I joined Telefónica Tech to start out the BI Staff.
Cristina Perez Martinez:
I began working at Telefónica in 2019 as a Python developer, and I moved to Telefónica Tech in 2021. My staff has primarily been working as Knowledge Engineers and Knowledge Architects for the BI staff.
Would you thoughts describing Telefónica, and the way your information staff helps the group?
Cristina:
Telefónica is split into fairly a couple of totally different corporations, however as an entire, it’s a Telecommunications Enterprise. Right here, in Telefónica Tech, the digital enterprise unit, we’ve been targeted on digital applied sciences similar to AI & BD, connectivity and IoT, Cybersecurity, Cloud, and Blockchain.
Our staff is split into two, with a part of the staff targeted on structure and engineering, getting uncooked information, then standardizing and remodeling it till it goes into Snowflake, our Knowledge Warehouse. The remainder of the staff is concentrated on Knowledge Evaluation, based mostly in Snowflake and coding in SQL. From there, they develop dashboards in PowerBI.
Ezequiel:
Telefónica Tech has a staff engaged on IoT and Huge Knowledge for exterior use instances, however our staff is chargeable for inner use instances, supporting the corporate. We assist infrastructure, transformation, and for nearly a 12 months now, Knowledge Governance.
What does your information stack appear like?
Ezequiel:
Our stack relies on Microsoft Azure, and we use Knowledge Manufacturing unit for Orchestration. We use Databricks’ ETL instrument, blob storage, and information lake. Snowflake is Telefónica’s information warehouse.
Why seek for an Energetic Metadata Administration resolution? What was lacking?
Ezequiel:
Our firm has over 6,200 folks, however our staff is small relative to your complete group. So if it’s essential to enhance information democratization, then that wouldn’t be attainable with out self-service, and with out Knowledge Governance.
Why was Atlan a superb match? Did something stand out throughout your analysis course of?
Ezequiel:
We have been first searching for a cloud-based SaaS resolution that was straightforward to deploy and straightforward to arrange.
Cristina:
Our purpose was to have a spot the place we may create a catalog of information that was accessible sufficient to the remainder of the corporate. It was additionally essential to know the lineage between Snowflake and PowerBI. Our main purpose was to know the influence that modifying a supply would have on our information warehouse, so column-level lineage ensures end-to-end visibility and traceability. Moreover, we acknowledge the necessity for a sturdy instrument to strengthen safety of our information platform, permitting us to assign roles and permissions to make sure that solely approved folks have entry to particular data, in addition to the flexibility to carry out audits which is important to take care of the integrity and compliance of our information operations.
What do you propose on creating with Atlan? Do you have got an thought of what use instances you’ll construct, and the worth you’ll drive?
Cristina:
One of many necessities we had is to create considerably of a market for our information, with the whole lot based mostly on Atlan belongings, and we’re engaged on launching that to start with of this 12 months. From there, we’re wanting ahead to populating much more metadata in Atlan and Snowflake.
Sooner or later, we’re enthusiastic about the potential of utilizing Atlan AI. Our purpose is to make accessing information even simpler for folks, and with the ability to chat with Atlan about information would make it straightforward for folks to seek out what they want.
Photograph by Mario Caruso on Unsplash