Data Engineer II (Remote)
American Family Insurance
2021-10-20T21:06:21Z
Madison
Wisconsin
United States
Engineering
(No Timezone Provided)
Summary:
Determines and builds the technical solution(s) to allow unstructured data to be structured and used by Data Scientists. Seeks to understand the data being worked with as its often unstructured data sets. Often are data gurus who prepare data for all stages of the modeling process including exploration, training, testing, and deployment. As a Data Engineer II, you’ll work on collecting, storing, processing and building Business Intelligence and Analytics applications within our big data platform. Presently, our team is constructing an enterprise data lake to enable analysts and scientists to self-service data at scale across American Family’s operating companies. We’re leveraging technologies like Python, Big Query, Composer and other cloud native tools to curate high-quality data sets. You’ll also be responsible for integrating these applications with the architecture used across the organization. Adjacent responsibilities include establishing best practices with respect to data integration, data governance, data visualization, schema design, performance and reliability of data processing systems, supporting data quality, and enabling convenient access to data for our scientists and business users.
Job Description:
Job Level Summary
Requires in-depth conceptual and practical knowledge in own job discipline and basic knowledge of related job disciplines Solves complex problems Works independently, receives minimal guidance May lead projects or project steps within a broader project or may have accountability for on-going activities or objectives Acts as a resource for colleagues with less experience Primary Accountabilities
Perform exploratory data analysis to determine which questions can be answered effectively with a given dataset. Ability to analyze new (possibly unstructured) data sources to determine what additional value they may bring. Design and develop highly scalable and extensible data pipelines from internal and external sources. Work on cross-functional teams to design, develop, and deploy data-driven applications and products. Prototype emerging technologies involving data ingestion and transformation, distributed file systems, databases and frameworks. Design, build, and maintain tools to increase the productivity of application development and client facing teams. Partner with business analyst to define, develop, and automate data quality checks. Develop code, scripts, Extract Transform Load (ETL) mappings, stored procedures, queries and analytical applications. Education and Licenses
Bachelor’s degree in computer science or related field, or equivalent combination of education and experience. Travel Requirements
This position requires travel up to 10% of the time. Specialized Knowledge & Skills Requirements
Demonstrated experience providing customer-driven solutions, support or service. In-depth knowledge of SQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores). Past expertise in SQL server technologies such as SSIS is preferred. Hands-on programming experience in Python or java, with an emphasis towards building ETL workflows and data-driven solutions. Experience with cloud computing platforms (e.g. GCP,AWS, Azure) or willingness to learn cloud technology is acceptable for this position Good data understanding and business acumen in the data rich industries like insurance or financial Solid understanding of data modeling principles (e.g. dimensional modeling and star schemas). Solid understanding of database internals, such as indexes, binary logging, and transactions. Solid understanding of Infrastructure as Code (e.g. Docker, CloudFormation, Terraform, etc.) Solid understanding of with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
Additional Job Information:
When you work at American Family you can expect benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, and a paid-time off program. In addition, our student loan repayment program and paid-family leave are available to support our employees and their families.Interns and contingent workers are not eligible for American Family Enterprise benefits.
We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
Data Engineer II (Remote)
American Family Insurance
Summary:
Determines and builds the technical solution(s) to allow unstructured data to be structured and used by Data Scientists. Seeks to understand the data being worked with as its often unstructured data sets. Often are data gurus who prepare data for all stages of the modeling process including exploration, training, testing, and deployment. As a Data Engineer II, you’ll work on collecting, storing, processing and building Business Intelligence and Analytics applications within our big data platform. Presently, our team is constructing an enterprise data lake to enable analysts and scientists to self-service data at scale across American Family’s operating companies. We’re leveraging technologies like Python, Big Query, Composer and other cloud native tools to curate high-quality data sets. You’ll also be responsible for integrating these applications with the architecture used across the organization. Adjacent responsibilities include establishing best practices with respect to data integration, data governance, data visualization, schema design, performance and reliability of data processing systems, supporting data quality, and enabling convenient access to data for our scientists and business users.
Job Description:
Job Level Summary
Requires in-depth conceptual and practical knowledge in own job discipline and basic knowledge of related job disciplines Solves complex problems Works independently, receives minimal guidance May lead projects or project steps within a broader project or may have accountability for on-going activities or objectives Acts as a resource for colleagues with less experience Primary Accountabilities
Perform exploratory data analysis to determine which questions can be answered effectively with a given dataset. Ability to analyze new (possibly unstructured) data sources to determine what additional value they may bring. Design and develop highly scalable and extensible data pipelines from internal and external sources. Work on cross-functional teams to design, develop, and deploy data-driven applications and products. Prototype emerging technologies involving data ingestion and transformation, distributed file systems, databases and frameworks. Design, build, and maintain tools to increase the productivity of application development and client facing teams. Partner with business analyst to define, develop, and automate data quality checks. Develop code, scripts, Extract Transform Load (ETL) mappings, stored procedures, queries and analytical applications. Education and Licenses
Bachelor’s degree in computer science or related field, or equivalent combination of education and experience. Travel Requirements
This position requires travel up to 10% of the time. Specialized Knowledge & Skills Requirements
Demonstrated experience providing customer-driven solutions, support or service. In-depth knowledge of SQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores). Past expertise in SQL server technologies such as SSIS is preferred. Hands-on programming experience in Python or java, with an emphasis towards building ETL workflows and data-driven solutions. Experience with cloud computing platforms (e.g. GCP,AWS, Azure) or willingness to learn cloud technology is acceptable for this position Good data understanding and business acumen in the data rich industries like insurance or financial Solid understanding of data modeling principles (e.g. dimensional modeling and star schemas). Solid understanding of database internals, such as indexes, binary logging, and transactions. Solid understanding of Infrastructure as Code (e.g. Docker, CloudFormation, Terraform, etc.) Solid understanding of with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
Additional Job Information:
When you work at American Family you can expect benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, and a paid-time off program. In addition, our student loan repayment program and paid-family leave are available to support our employees and their families.Interns and contingent workers are not eligible for American Family Enterprise benefits.
We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.