JOB DESCRIPTION
Fox Technology Data Products team is seeking an experienced Lead Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Platforms and Data Engineering solutions. If you believe in a data-first strategy and enjoy solving complex business problems using data in a fast-paced, collaborative environment, then this role is for you.
A SNAPSHOT OF YOUR RESPONSIBILITIES
Partner with business and product owners to successfully execute data strategy and deliver data platform roadmap
Collaborate with and across Agile teams to design, develop, test, implement, and support data engineering solutions by rapidly delivering value to our customers
Manage and mentor squads comprising of data engineers and data analysts to develop and deliver most efficient, reusable, and high-quality data engineering solutions
Influence overall data platform and product architectures
Build distributed, low latency, reliable data pipelines ensuring the availability and timely delivery of data
Build distributed, low latency, reliable data pipelines ensuring the availability and Data Engineering team
Conduct reviews with other team members to make sure the code is elegantly designed, efficiently coded, and effectively tuned for performance
Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques
Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
Communicate clearly and effectively to technical and non-technical leadership
WHAT YOU WILL NEED
10+ years of experience in Data Engineering and Data Platforms
A minimum of 3 years of experience in a similar role
5+ years of experience in a Lead position managing team of data engineers and analysts
8+ years of experience building highly effective data platforms and data engineering pipelines using Python, PySpark
Extensive experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark using managed data platforms such as Amazon EMR or Data Bricks
Extensive experience working with batch, hybrid and real-time data processing solutions
Experience in architecting, designing, and developing applications on the AWS platform
Experience working with fully automated workflow scheduling services such as Apache AirFlow
Experience with CI/CD using GitHub Actions, Jenkins
Experience with version control tools such as GitHub and Bitbucket
Expertise in designing and building applications using Container and serverless technologies
Advanced SQL knowledge, extensive experience working with RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift
Excellent communication, adaptability, and collaboration skills
Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
NICE TO HAVE, BUT NOT A DEAL BREAKER
Bachelor’s degree in Computer Science, Computer Engineering, or relevant field
Experience working with data acquisition and transformation tools such as Fivetran and DBT
Fox Corporation
Remote Oregon
United States
Engineering
(No Timezone Provided)
JOB DESCRIPTION
Fox Technology Data Products team is seeking an experienced Lead Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Platforms and Data Engineering solutions. If you believe in a data-first strategy and enjoy solving complex business problems using data in a fast-paced, collaborative environment, then this role is for you.
A SNAPSHOT OF YOUR RESPONSIBILITIES
Partner with business and product owners to successfully execute data strategy and deliver data platform roadmap
Collaborate with and across Agile teams to design, develop, test, implement, and support data engineering solutions by rapidly delivering value to our customers
Manage and mentor squads comprising of data engineers and data analysts to develop and deliver most efficient, reusable, and high-quality data engineering solutions
Influence overall data platform and product architectures
Build distributed, low latency, reliable data pipelines ensuring the availability and timely delivery of data
Build distributed, low latency, reliable data pipelines ensuring the availability and Data Engineering team
Conduct reviews with other team members to make sure the code is elegantly designed, efficiently coded, and effectively tuned for performance
Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques
Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
Communicate clearly and effectively to technical and non-technical leadership
WHAT YOU WILL NEED
10+ years of experience in Data Engineering and Data Platforms
A minimum of 3 years of experience in a similar role
5+ years of experience in a Lead position managing team of data engineers and analysts
8+ years of experience building highly effective data platforms and data engineering pipelines using Python, PySpark
Extensive experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark using managed data platforms such as Amazon EMR or Data Bricks
Extensive experience working with batch, hybrid and real-time data processing solutions
Experience in architecting, designing, and developing applications on the AWS platform
Experience working with fully automated workflow scheduling services such as Apache AirFlow
Experience with CI/CD using GitHub Actions, Jenkins
Experience with version control tools such as GitHub and Bitbucket
Expertise in designing and building applications using Container and serverless technologies
Advanced SQL knowledge, extensive experience working with RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift
Excellent communication, adaptability, and collaboration skills
Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
NICE TO HAVE, BUT NOT A DEAL BREAKER
Bachelor’s degree in Computer Science, Computer Engineering, or relevant field
Experience working with data acquisition and transformation tools such as Fivetran and DBT