Mid-Level Data Engineer
Tasks
- Build materialized views and semantic layer objects
- Configure ETL metadata in PostgreSQL
- Deploy ETL resources using CloudFormation templates
- Develop ETL pipelines
- Ingest structured and semi structured datasets
- Integrate ETL common library into Glue jobs
- Monitor production ETL jobs
- Support agile sprint ceremonies and planning
- Support disaster recovery exercises
- Update load reports and gap reports
- Write ETL documentation
- Write unit and integration tests
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | Apache Iceberg | CI/CD | CloudFormation | GitHub | Integration Testing | Jira | ORC | Oracle | Parquet | PostgreSQL | PySpark | Python | SQL | Trino | Unit Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Amazon Web Services | Automated testing | Cloud Native | Cloud platformBonuses | Disability insurance | Employee resource groups | Inclusive culture | Life insuranceSenior-level Full TimeRemote, India R6h ago
-
Apache Spark | Data Lineage | Data Modeling | Data Quality | Data Quality ManagementRemote work | W2 employmentMid-level Full TimeChicago, IL. R9h ago
-
Generative AI Developer USD 100K-211KAI Services | Azure | Azure AI | Azure AI Services | Computer Vision5 days working | Certification Culture | Monthly Performance Review | Permanent Remote | Technical growthMid-level Full TimeRemote R9h ago
-
Senior DevOps ML Engineer USD 119K-258KAccess Control | Azure | Azure Databricks | CI/CD | ComplianceComprehensive healthcare | Fully remote | International projects | Long-term B2B contract | Multinational environmentSenior-level Full TimeRemote R9h ago
-
Cloud Engineer USD 128K-298KAWS | Active Directory | Audit Logging | Azure | Azure DevOpsFlexible-hybrid work | Monday to Friday schedule | Onsite or remote workSenior-level Full TimeFlexible Hybrid R11h ago
-
Apache Kafka | Apache Spark | Azure HDInsight | Batch Processing | CI/CDCareer development | Community volunteering | Conferences and tech events | Employee representative council | Health insuranceSenior-level Full TimeNantes, Pays de la Loire, France R13h ago
-
API Development | Agile | Generative AI | Lean | PythonChildcare spots | Flexible equipment | Inclusion programs | Learning culture | Meal vouchersSenior-level Full TimeLille, Hauts-de-France, France R13h ago
-
Analytics Engineer EUR 52K-78KAmazon Web Services | DBT | Dagster | Data Modeling | Data QualityEco vouchers | Employee discounts | Health insurance | Laptop | Meal vouchersMid-level Full TimeMechelen, Belgium R14h ago
-
Software Engineer (Backend Developer) INR 1500K-3500KAWS | Active Directory | Agile | Algorithms | Data StructuresMid-level Full TimeBangalore, India Office (BANGALORE) R14h ago
-
MLOps Engineering Specialist GBP 55K-58KAWS | AWS CDK | AWS CloudFormation | Alerting | Amazon SageMakerDiscounted mobile and broadband | Equalized maternity paternity adoption leave | Gym memberships | Holiday purchase scheme | Online private GP 24 7Mid-level Full TimeLondon, GB, E1 8EP R15h ago
-
AI Engineer RON 312K-396KAPI Development | AWS | Azure | Cloud Computing | Cloud platformGym support | Hybrid work environment | Medical benefits | Team events | Wellbeing programsSenior-level Full TimeEmployees can work remotely, Romania R15h ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Amazon Redshift | Apache Airflow | Automated Feature EngineeringTelecommuting 100 percentSenior-level Full TimeUS- remote R19h ago
-
Senior Software Engineer, Data Infrastructure USD 191K-225KAWS EMR | Airflow | Concurrency | Distributed Systems | Fault-tolerantBonus | Employee travel credits | EquitySenior-level Full TimeUSA - Remote R19h ago
-
AI Document Intelligence | AI content understanding | API Development | Agile Kanban | Agile ScrumFlexible vacation policy | Fully remote | Home office support allowance | Indefinite contract option | Learning and development bonusMid-level Full TimeMexico R19h ago
-
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 74K-103KAI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial IntelligenceHybrid schedule | Travel opportunities | Workshops and community engagementSenior-level Full TimeLondon, United Kingdom R20h ago
-
AI Agents | AWS | Apache Spark | Artificial Intelligence | Big DataHybrid work | Travel for customer visits and eventsSenior-level Full TimeParis, France R20h ago
-
Embedded Software Engineer I USD 106K-170KAlgorithms | C# | C++ | DHCP | DNSDental insurance | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsMid-level Full TimeSeattle, Washington, United States R23h ago
-
Senior AI Data Engineer | WFH | Dayshift PHP 80K-160KAWS | Azure | CI/CD | Data Governance | DevOpsOn-call rotations | Shift flexibility | Work from homeSenior-level Full TimeTaguig City, PH R23h ago
-
Senior Full-Stack Engineer, Gen AI @MarshTech (Open) RON 295K-387KAgile | Angular | Kubernetes | Language Models | Large Language Models30 days off | Charity days off | Flexible benefits package | Hackathons | Hybrid workSenior-level Full TimeCluj-Napoca - Decembrie, Romania R23h ago
-
Senior-level Full TimeQuezon City, Metro Manila, Philippines - … R23h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch Processing | ChunkingCommunity of Practice | Hybrid work schedule | Mentorship opportunitiesSenior-level Full TimeHartford CT- Home Office, United States R23h ago
-
Software Engineer (AI/ML) USD 110K-177KAWS | Agile | Azure | Docker | GCP401k match | Dental insurance | Employee assistance program | Health insurance | Paid parental leaveMid-level Full TimeBoston, United States R23h ago
-
Principal Software Engineer - AI INR 2475K-3500KAgentic AI | Autogen | Continuous Delivery | Distributed Systems | GraphRAGSenior-level Full TimeBangalore - Carina, India R23h ago
-
Mid-level Full TimeIND GBS Bangalore - Office, India R23h ago
-
Data Engineer AI USD 165K-216KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | AirflowWork-life balanceSenior-level Full TimeTelecommuter TN, United States R23h ago