Senior Data Engineer
Tasks
- Apply data security and governance
- Build AWS cloud native data solutions
- Build reusable data engineering frameworks
- Design and maintain data models
- Design data products
- Design implement support workflow orchestration
- Develop lakehouse solutions with Apache Iceberg
- Ensure data quality auditability lineage compliance
- Implement CI CD pipelines automated testing infrastructure as code
- Integrate and transform data into trusted datasets
- Optimize distributed processing workloads
- Standardize ingestion transformation orchestration monitoring data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon CloudWatch | Amazon ECS | Amazon EKS | Amazon EMR | Apache Airflow | Apache Iceberg | Apache Spark | CI/CD | Data Governance | Data Lineage | Data Quality | Data Security | Data masking | Encryption | Infrastructure as Code | Metadata Management | PySpark | “as-code”
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2h ago
-
Senior-level ContractRaleigh, United States2h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York4h ago
-
AWS | Artificial Intelligence | Cloud platform | Data Architecture | Data GovernanceTravel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …4h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA6h ago
-
Senior-level Full TimeUnited States12h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States15h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States17h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States17h ago
-
Data Engineer, Consultant USD 125K-164KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOakland, CA, United States17h ago
-
Principal Embedded Software Engineer - OS Build USD 152K-229KArtifactory | BSP | Bamboo | Bash | BitbucketSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States17h ago
-
Principal Embedded Software Engineer - OS Build USD 152K-229KArtifactory | Atlassian | BSP | Bamboo | BashSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States17h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States17h ago
-
Gen AI - CVS - Dallas USD 36K-126KAPI Gateway | Aiohttp | Amazon Web Services | Asyncio | CI/CD401k retirement plan | Medical, dental, vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States18h ago
-
Senior Numerical Optimization Engineer USD 191K-253KAPIs | C++ | CI/CD | CPLEX | Cloud ComputingComprehensive benefits | Health insurance | Paid on-call supportSenior-level Full TimeCosta Mesa, California, United States18h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States19h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA19h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA19h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City19h ago
-
Sr. Engineer, Firmware & Embedded Software USD 79K-158KAgile | Azure DevOps | BDM | Bare Metal | BootloaderOccasional travel for onboarding | Remote work within the United StatesSenior-level Full TimeFlorida, United States R20h ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-160KAPI Development | Agile | Backend Development | Cloud Native | Code review401k | Employee discount program | Employee referral program | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, MD, US R20h ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-170KAPI Development | Agile | Backend Development | Cloud Computing | Data Architecture401k | Employee discount program | Employee referral rewards | Flexible spending accounts | Flexible work scheduleMid-level Full TimeQuantico, VA, US R20h ago
-
Sr. Business Intelligence Engineer USD 110K-150KAzure Data | Azure Data Lake | Azure DevOps | CI/CD | Change Data CaptureDental benefits | Employee discounts | Employee recognition | Employee referral bonus | Medical benefitsSenior-level Full TimeHouston, Texas, United States20h ago
-
AI R&D Engineer Co-op USD 168K-232KApache Cassandra | Apache Kafka | Apache Spark | Deep learning | Machine LearningNone Full TimeUnited States20h ago
-
AI R&D Engineer Co-op USD 168K-232KApache Kafka | Apache Spark | Cassandra | Deep learning | Machine LearningNone Full TimeUnited States20h ago