Data Engineer 2
USA-CORP Chicago IL-Chicago, United States
USD 100K-140K Mid-level Full Time
Tasks
- Apply AI tools to enhance data platforms
- Automate deployment using CI CD practices
- Build and maintain data ingestion transformation and indexing pipelines
- Collaborate on cloud infrastructure and security
- Contribute to documentation and best practices
- Create APIs for data integration
- Design build and optimize scalable ETL jobs using PySpark
- Develop and support data architecture and governance frameworks
- Leverage indexing solutions and databases
- Optimize cluster operations and Spark jobs
Perks/Benefits
Skills/Tech-stack
AI/ML | API Development | AWS | Azure | CI/CD | Cache databases | Cloud Platforms | Data Governance | Data Lake | Data Lake Architecture | Data Pipelines | Databricks | DocumentDB | GCP | GitHub | GitHub Actions | PySpark | SQL
Education
Bachelor of Engineering | Bachelor of Science | Information Technology
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R6d ago
-
Mid-level Full TimeCenter, Center District, IL2h ago
-
Tech Risk and Control [Multiple Positions Available] USD 173K-215KAI | AWS | AWS SageMaker | Aqua Security | AzureFinancial coaching | Health care coverage | Mental health support | On-site wellness | Retirement planSenior-level Full TimePlano, TX, United States4h ago
-
Data and Analytics Lead, Payments Compliance USD 142K-205KAutomation | Data Infrastructure | Data Management | Data Visualization | Data WarehousingFlexible work arrangements | Health insurance | Paid time offSenior-level Full TimeChicago, IL, USA; Austin, TX, USA6h ago
-
Software Engineer II - Data / ETL USD 170K-201KAPIs | AWS | CI/CD | Data Engineering | DatabricksFinancial coaching | Health care coverage | Mental health support | On-site wellness | Retirement planMid-level Full TimePlano, TX, United States13h ago
-
Senior Data Engineer & Architect USD 173K-331KAirflow | Cloud Platforms | Data Governance | Data Modeling | Data QualityFlexible work hours | Health insurance | Professional development programsSenior-level Full TimeSan Jose, United States17h ago
-
AWS | Airflow | Big Data | CI/CD | CloudWatchAdoption Assistance | Disability insurance | Healthcare | Leave accrual | Life insuranceSenior-level Full TimeCharlotte, NC, United States17h ago
-
Azure | CSS | Docker | Druid | GitAdoption Assistance | Disability insurance | Healthcare | Life insurance | Paid HolidaysSenior-level Full TimeIrving, TX, United States17h ago
-
EverCommerce - Sr. BI Engineer USD 115K-135KData Modeling | Data Transformation | Data Warehousing | Dimensional Modeling | ETL401k match | Flexible time off | Health and wellness benefits | Remote work | Stock purchase programSenior-level Full TimeRemote- US, United States R17h ago
-
Staff Data Engineer USD 169K-253KAWS | Azure | Data Modeling | Data Pipelines | Data VisualizationBonuses | Disability insurance | Health insurance | Life insurance | Long-term incentivesSenior-level Full TimeMDLI03, United States17h ago
-
Senior Data Engineer USD 90K-90KAWS | Airflow | Batch | CICD | Cloud deploymentAdoption Assistance | Back-Up childcare | Dental | Disability insurance | Employee assistance programSenior-level Full TimeBoston, United States17h ago
-
Senior Security Analytics Data Engineer USD 109K-182KBig Data | BigQuery | Cloud Databases | Data Analysis | Data AutomationOn-site work | Travel allowanceSenior-level Full TimeColumbus, Ohio, United States17h ago
-
AI Governance | CI/CD | Cloud Platforms | Dask | Data EngineeringBenefits | Health coverage | Inclusive environmentSenior-level Full TimeNew York, NY, United States17h ago
-
Senior Machine Learning Engineer USD 161K-184KCloud Platforms | Data Pipelines | Distributed Computing | Java | Machine LearningFinancial benefits | Health benefits | Inclusive work environmentSenior-level Full TimeMcLean, VA, United States17h ago
-
Data Modeling | Data Transformation | Data Visualization | ETL Pipelines | Power BIProfessional development opportunities | Remote work optionEntry-level Full Time InternshipRancho Cordova, CA, United States1d ago
-
Senior DataOps Engineer USD 140K-187KAWS | Cassandra | Data Governance | Data Modeling | Databricks401k match | Bereavement leave | Dental insurance | Income protection | Jury duty leaveSenior-level Full TimeCharlotte, NC, United States1d ago
-
Airflow | Data Pipeline Architecture | Data pipeline | Debugging | GitHybrid role | Location flexibilitySenior-level Full TimeDallas, Texas, United States1d ago
-
Principal Software Engineer - Python USD 120K-200KAI | API Development | Cloud services | Distributed Systems | DockerSenior-level Full TimeBoston, Massachusetts, United States1d ago
-
Data Engineer, Enterprise Data, Analytics and Innovation USD 110K-125KAirflow | DBT | Data Governance | Data Modeling | Data Security401k plan | Flexible time off | Health benefits | Parental leave | Remote workMid-level Full TimeUnited States R1d ago
-
AI Engineer (TLM - 001) USD 101K-195KAI Development | AWS | Cloud Computing | Data Analysis | Machine LearningEqual employment opportunity | Telework optionMid-level Full TimeAnnapolis Junction, Maryland, United States1d ago
-
DevOps Engineer – Cloud Transformation & AI Enablement USD 120K-170KAWS | Automation | Azure | CI/CD | Container OrchestrationCollaborative culture | Impact-driven environment | Professional developmentMid-level Full TimeScottsdale, Arizona, United States1d ago
-
AWS | Backend Development | Cloud infrastructure | Frontend Development | Full StackCollaborative team | Flexible work environment | Impact on food innovationSenior-level Full TimeSeattle1d ago
-
Scientific Data Engineer USD 120K-160KData Analysis | Data Engineering | Data Manipulation | ETL Pipelines | Python401k | Dental insurance | Equity | Health insurance | Paid time offMid-level Full TimeSan Francisco, New York1d ago
-
Mid-level Full TimeUnited States R1d ago
-
Embedded Software Engineer USD 140K-220KBuildroot | C++ | CI/CD | CMake | DebuggingAccommodation support | Inclusive environmentSenior-level Full TimeLos Angeles, CA1d ago