Sr. Software Engineer (REMOTE)

Epsilon

Chicago Illinois

United States

Information Technology
(No Timezone Provided)

Job Description

About the Opportunity

We are seeking a  Senior Software Engineer  who wants to own major components of our data processing platform. You will be dedicated to systems architecture, capacity, security, stability, and data flow issues throughout our platform.

Duties and Responsibilities:

  • Build and maintain scheduler platform based on Apache Airflow and Kubernetes.
  • Extend Apache Airflow with modules and plugins.
  • Coordinate with supporting teams for services used by Apache Airflow (Kubernetes, ELK, Postgres, Grafana)
  • Build and maintain support infrastructure for data processing job.
  • Develop tools that automate the operations, administration, and tuning of large, distributed clusters.
  • Develop tools to enable the development and optimization of distributed data workflow pipelines.
  • Administration of back-end systems architecture, as well as contribution to the overall design to monitor and sustain our high standards of availability, security and performance.
  • Qualifications:

  • 4+ years software development experience in a highly scalable, distributed, large multi-node environment.
  • Experience with *nix OS environments (CentOS, Alpine) including shell scripting
  • Extensive software development experience in Python
  • Experience with SCM tools, ideally git.
  • Experience with Atlassian tools (Bitbucket, Confluence, Bamboo)
  • Experience with virtual machine technologies, specifically Docker and Kubernetes
  • Familiarity with Kubernetes admin tools (kubectl, Helm, Helmsman)
  • Strong troubleshooting and performance tuning skills.
  • Systems monitoring and management for grid computing.
  • Excellent communication skills
  • Strong presentation and interdisciplinary communication skills (written and verbal).
  • Bonus points for:

  • Having made contributions back to the open source community.
  • Experience running and modifying Apache Airflow
  • Experience with Swagger and OpenAPI
  • Additional Information

    Great People, Deserve Great Benefits
    We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly. If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.

    Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories.

    Epsilon will provide accommodations to applicants needing accommodations to complete the application process.

    For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. 

    Applicants with criminal histories are welcome to apply.

    #LI-AE1

    Sr. Software Engineer (REMOTE)

    Epsilon

    Chicago Illinois

    United States

    Information Technology

    (No Timezone Provided)

    Job Description

    About the Opportunity

    We are seeking a  Senior Software Engineer  who wants to own major components of our data processing platform. You will be dedicated to systems architecture, capacity, security, stability, and data flow issues throughout our platform.

    Duties and Responsibilities:

  • Build and maintain scheduler platform based on Apache Airflow and Kubernetes.
  • Extend Apache Airflow with modules and plugins.
  • Coordinate with supporting teams for services used by Apache Airflow (Kubernetes, ELK, Postgres, Grafana)
  • Build and maintain support infrastructure for data processing job.
  • Develop tools that automate the operations, administration, and tuning of large, distributed clusters.
  • Develop tools to enable the development and optimization of distributed data workflow pipelines.
  • Administration of back-end systems architecture, as well as contribution to the overall design to monitor and sustain our high standards of availability, security and performance.
  • Qualifications:

  • 4+ years software development experience in a highly scalable, distributed, large multi-node environment.
  • Experience with *nix OS environments (CentOS, Alpine) including shell scripting
  • Extensive software development experience in Python
  • Experience with SCM tools, ideally git.
  • Experience with Atlassian tools (Bitbucket, Confluence, Bamboo)
  • Experience with virtual machine technologies, specifically Docker and Kubernetes
  • Familiarity with Kubernetes admin tools (kubectl, Helm, Helmsman)
  • Strong troubleshooting and performance tuning skills.
  • Systems monitoring and management for grid computing.
  • Excellent communication skills
  • Strong presentation and interdisciplinary communication skills (written and verbal).
  • Bonus points for:

  • Having made contributions back to the open source community.
  • Experience running and modifying Apache Airflow
  • Experience with Swagger and OpenAPI
  • Additional Information

    Great People, Deserve Great Benefits
    We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly. If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.

    Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories.

    Epsilon will provide accommodations to applicants needing accommodations to complete the application process.

    For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. 

    Applicants with criminal histories are welcome to apply.

    #LI-AE1