Data Engineer
Tasks
- Build AI ready data pipelines for multi source data fusion and analytics
- Collaborate with cross functional teams for mission applications and AI governance
- Design distributed data processing pipelines for operational AI
- Develop and optimize streaming architectures for data ingestion and transformation
- Ensure data lineage and metadata management
- Implement and manage enterprise data layer
- Integrate Spark Kafka Trino ClickHouse Iceberg and OpenSearch
- Monitor observability and enable scalable software delivery
- Secure and scale data pipelines using DevSecOps practices
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | ClickHouse | Cybersecurity | Data Fusion | Data Ingestion | Data Lineage | Data Modeling | Data Processing | Data Transformation | DevSecOps | Distributed data | Distributed data processing | Enterprise Data | Enterprise Data Modeling | Metadata Management | Multi Source Data Fusion | Multi-source data | Observability | OpenSearch | Real Time | Real-time analytics | Streaming Data | Streaming data ingestion | Trino
Education
N/A
Roles
Related jobs
-
Analytics Engineer USD 164K-229KAirflow | Apache Spark | Data Governance | Data Modeling | Data Visualization401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R7h ago
-
Senior Analytics Engineer USD 190K-267KAirflow | Apache Spark | D3.js | Data Governance | Data Modeling401k employer match | Flexible vacation | Healthcare benefits | Mental health and coaching | Paid parental leaveSenior-level Full TimeRemote - United States R7h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS | AWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMRMid-level Full TimeBellevue, Washington, USA8h ago
-
Data Engineer II, DBS BI USD 132K-178KAWS Glue | AWS Lake Formation | Amazon Athena | Amazon EMR | Amazon QuickSightMid-level Full TimeBellevue, Washington, USA8h ago
-
Senior Analytics Engineer, People Data USD 166K-220KAWS Redshift | AWS S3 | Apache Airflow | Apache Iceberg | Apache SparkSenior-level Full TimeBoston, Massachusetts, United States; Costa Mesa, …10h ago
-
Machine Learning Engineer, Infrastructure USD 167K-210KAWS | Airflow | Apache Beam | Apache Spark | AzureSenior-level Full TimeMenlo Park, California, United States10h ago
-
Data Engineer USD 119K-170KAWS | Amazon Web Services | Apache Spark | Automation | Cloud ArchitectureSecurity ClearanceSenior-level Full TimeArlington, VA12h ago
-
Senior Data Engineer (Azure & Databricks) USD 175K-247KAWS | Apache Spark | Azure | CRM Integration | Cloud platformSenior-level Full TimeDallas, TX, United States12h ago
-
Senior-level Full TimeUnited States13h ago
-
Senior Data Engineer (5307) USD 125K-180KAWS | Azure | CI/CD | Case design | Data ModelingHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeArlington, VA13h ago
-
Senior-level Full TimeWashington, D.C.13h ago
-
Principal GenAI Data Engineer USD 182K-260KArize Phoenix | Clustering | CrewAI | Data Engineering | Data IngestionEducation reimbursement | Health plans | Parental leave | Remote work | Retirement optionsSenior-level Full TimeUSA - Update Location R13h ago
-
AI Savvy Data Analyst USD 127K-214KAnomaly Detection | Cause analysis | Data Governance | Data Management | Data ModelingAdditional day off | Competitive benefits package | ESG focused mission | Flex days | Flexible work hoursMid-level Full TimeDenver, CO, United States R14h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Apache Kafka | Apache Spark | Artificial Intelligence | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R14h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNew York, New York, United States14h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAI Agents | AWS | Ad Exchanges | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeSan Francisco, California, United States14h ago
-
Data Engineer USD 160K-191KAirflow | Amazon CloudWatch | Amazon S3 | DBT | DagsterOffice access | Remote work | Travel for team meetingsSenior-level Full TimeNew York, New York, United States R15h ago
-
Principal Engineer - Data and Infrastructure, Remote USD 150K-200KAWS | Azure | C# | CI/CD | Container Orchestration401k match | Clinical employee reimbursement | Dental insurance | Educational assistance | Flexible work schedulesSenior-level Full TimeRemote, United States R15h ago
-
Data Engineer - Wrapped - Fixed Term USD 125K-179KApache Spark | Big Data | BigQuery | Cloud Dataflow | Data ModelingWork from home flexibilityMid-level TemporaryNew York, NY16h ago
-
Data Platform Engineer USD 100K-150KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Iceberg401k match | Annual performance reviews and career development | Company equipment provided | Company in person events and team outings | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R16h ago
-
AI Architect - Business Applications USD 138K-225KA/B | A/B Testing | Access Control | Agent Frameworks | B testingCareer growth opportunities | Hybrid work optionSenior-level Full TimeSan Francisco, CA, United States17h ago
-
Senior AI Engineer - AI & Credit Analytics USD 135K-215KAWS | CI/CD | Cloud Computing | Data Governance | Generative AIRemote workSenior-level Full Time,, ,, United States R17h ago
-
Senior Applied Scientist USD 136K-165KAudio Processing | C++ | Cloud Computing | Continuous Deployment | Dialog Systems401k retirement plan | Dental insurance | Diversity and inclusion programs | Employee referral bonus | Employee resource groupsSenior-level Full TimeSeattle, WA17h ago
-
Data Engineer USD 116K-243KAI Ready | AI-Ready Data | AI-ready data pipelines | ClickHouse | CybersecurityCertifications | Hands-on experience | Industry trainingSenior-level Full TimeArlington, VA17h ago
-
AI Engineer USD 100K-203KArtificial Intelligence | DevSecOps | GPU Inference | GPU Performance | GPU Performance OptimizationSenior-level Full TimeArlington, VA17h ago