Data Engineer
Tasks
- Build AI ready data pipelines for multi source data fusion and analytics
- Collaborate with cross functional teams for mission applications and AI governance
- Design distributed data processing pipelines for operational AI
- Develop and optimize streaming architectures for data ingestion and transformation
- Ensure data lineage and metadata management
- Implement and manage enterprise data layer
- Integrate Spark Kafka Trino ClickHouse Iceberg and OpenSearch
- Monitor observability and enable scalable software delivery
- Secure and scale data pipelines using DevSecOps practices
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | ClickHouse | Cybersecurity | Data Fusion | Data Ingestion | Data Lineage | Data Modeling | Data Processing | Data Transformation | DevSecOps | Distributed data | Distributed data processing | Enterprise Data | Enterprise Data Modeling | Metadata Management | Multi Source Data Fusion | Multi-source data | Observability | OpenSearch | Real Time | Real-time analytics | Streaming Data | Streaming data ingestion | Trino
Education
N/A
Roles
Related jobs
-
Analytics Engineer USD 164K-229KAirflow | Apache Spark | Data Governance | Data Modeling | Data Visualization401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R6h ago
-
Senior Analytics Engineer USD 190K-267KAirflow | Apache Spark | D3.js | Data Governance | Data Modeling401k employer match | Flexible vacation | Healthcare benefits | Mental health and coaching | Paid parental leaveSenior-level Full TimeRemote - United States R6h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS | AWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMRMid-level Full TimeBellevue, Washington, USA7h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMR | Amazon QuickSightMid-level Full TimeBellevue, Washington, USA7h ago
-
Senior Analytics Engineer, People Data USD 166K-220KAWS Redshift | AWS S3 | Apache Airflow | Apache Iceberg | Apache SparkSenior-level Full TimeBoston, Massachusetts, United States; Costa Mesa, …9h ago
-
Machine Learning Engineer, Infrastructure USD 167K-210KAWS | Airflow | Apache Beam | Apache Spark | AzureSenior-level Full TimeMenlo Park, California, United States9h ago
-
Data Engineer USD 119K-170KAWS | Amazon Web Services | Apache Spark | Automation | Cloud ArchitectureSecurity ClearanceSenior-level Full TimeArlington, VA11h ago
-
Senior Data Engineer (Azure & Databricks) USD 175K-247KAWS | Apache Spark | Azure | CRM Integration | Cloud platformSenior-level Full TimeDallas, TX, United States11h ago
-
Senior-level Full TimeUnited States12h ago
-
Senior Data Engineer (5307) USD 125K-180KAWS | Azure | CI/CD | Case design | Data ModelingHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeArlington, VA12h ago
-
Senior-level Full TimeWashington, D.C.12h ago
-
Principal GenAI Data Engineer USD 182K-260KArize Phoenix | Clustering | CrewAI | Data Engineering | Data IngestionEducation reimbursement | Health plans | Parental leave | Remote work | Retirement optionsSenior-level Full TimeUSA - Update Location R12h ago
-
AI Savvy Data Analyst USD 127K-214KAnomaly Detection | Cause analysis | Data Governance | Data Management | Data ModelingAdditional day off | Competitive benefits package | ESG focused mission | Flex days | Flexible work hoursMid-level Full TimeDenver, CO, United States R12h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Apache Kafka | Apache Spark | Artificial Intelligence | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNew York, New York, United States13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAI Agents | AWS | Ad Exchanges | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeSan Francisco, California, United States13h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | Access Control | Agent Frameworks | B testingCareer growth opportunities | Hybrid work optionSenior-level Full TimeSan Francisco, CA, United States16h ago
-
Senior AI Engineer - AI & Credit Analytics USD 135K-215KAWS | CI/CD | Cloud Computing | Data Governance | Generative AIRemote workSenior-level Full Time,, ,, United States R16h ago
-
Senior Applied Scientist USD 136K-165KAudio Processing | C++ | Cloud Computing | Continuous Deployment | Dialog Systems401k retirement plan | Dental insurance | Diversity and inclusion programs | Employee referral bonus | Employee resource groupsSenior-level Full TimeSeattle, WA16h ago
-
Data Engineer USD 116K-243KAI Ready | AI-Ready Data | AI-ready data pipelines | ClickHouse | CybersecurityCertifications | Hands-on experience | Industry trainingSenior-level Full TimeArlington, VA16h ago
-
AI Engineer USD 100K-203KArtificial Intelligence | DevSecOps | GPU Inference | GPU Performance | GPU Performance OptimizationSenior-level Full TimeArlington, VA16h ago
-
AI Engineer USD 116K-243KCybersecurity | Deep learning | DevSecOps | GPU Inference | GPU inference optimizationSenior-level Full TimeArlington, VA16h ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ClusteringRelocation support | Visa transfer supportSenior-level Full TimeNew York16h ago
-
Azure Data Engineer (Telecommunications) USD 135K-165KApache Spark | Azure | CI/CD | DBT | Data QualitySenior-level ContractFrisco, United States17h ago
-
Lead Developer (Python) USD 125K-180KAPI Development | AWS | Amazon SageMaker | Apache Airflow | Apache KafkaFive day onsite schedule | On-site workSenior-level Full TimeAuburn Hills, MI, United States18h ago