Data Infrastructure Engineer
Build the next generation of scalable data infrastructure
Our Data Infrastructure team is a small group focused on delivering major impact as they build the scalable data infrastructure that ingests, analyzes and links data resources across the organization. We’re looking for individuals who are comfortable with autonomy, confident in moving fast, and are always looking for new ways to better understand and improve our users (data scientists and data engineers) experience. This is a highly collaborative team, so we need strong team players who are excited by the opportunity to learn, share knowledge, and are constantly finding ways to uplevel themselves and their teammates. Data Infrastructure’s core mission is to enable the most efficient and highest quality feature generation in service of building the next generation of data intelligence products.
You will work on:
Building and maintaining the infrastructure that enables highly-scalable ETL pipelines and data-driven systems that contribute towards building a compounding linked data asset. We work closely with product owners, data scientists, and machine learning engineers to build the data infrastructure that powers our intelligence products.
You’ll be responsible for all phases of the development cycle: design, implementation, testing, and release. Leveraging your deep knowledge and experience in taking ideas from zero to completion, you’ll create the platform that empowers product teams at Enigma to quickly explore, iterate and deliver world-class data intelligence.
We’re looking for someone who has:
-A strong background as a data engineer in building and shipping highly scalable distributed systems on cloud platforms (AWS/Azure/GCP) and database technologies (SQL/NoSQL/column-oriented data stores/distributed databases)
-Experience with the Big Data ecosystems (Hadoop/Hive/Spark/Airflow)
-A proven track record of leading and delivering large projects independently
-The proven ability to learn new technologies quickly
-In-depth knowledge and experience with Spark
-Experience with Python a plus