Data Engineer
Tasks
- Build AI-ready data pipelines
- Design distributed data processing pipelines
- Develop streaming architectures for real time ingestion
- Enable data lineage and metadata management
- Ensure data pipelines meet security and DevSecOps practices
- Implement enterprise data layer with metadata management
- Integrate Spark Kafka Trino ClickHouse Iceberg and OpenSearch
- Monitor observability and ensure scalable software delivery
- Support multi source data fusion for analytics
- Transform and ingest batch and streaming data
Perks/Benefits
Skills/Tech-stack
AI Ready | AI-Ready Data | AI-ready data pipelines | ClickHouse | Cybersecurity | Data Fusion | Data Ingestion | Data Lineage | Data Pipelines | Data Processing | Data Transformation | Data pipeline | DevSecOps | Distributed data | Distributed data processing | Iceberg | Kafka | Metadata Management | Multi Source Data Fusion | Multi-source data | OpenSearch | Spark | Streaming Data | Trino
Education
N/A
Roles
Related jobs
-
Staff Machine Learning Engineer - Edge AI USD 178K-319KC++ | Computer Vision | Data Pipelines | Edge Computing | Machine LearningHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R9h ago
-
Machine Learning Engineer, Infrastructure USD 167K-210KAWS | Airflow | Apache Beam | Apache Spark | AzureSenior-level Full TimeMenlo Park, California, United States10h ago
-
Data Engineer USD 119K-170KAWS | Amazon Web Services | Apache Spark | Automation | Cloud ArchitectureSecurity ClearanceSenior-level Full TimeArlington, VA12h ago
-
Senior Data Engineer (Azure & Databricks) USD 175K-247KAWS | Apache Spark | Azure | CRM Integration | Cloud platformSenior-level Full TimeDallas, TX, United States12h ago
-
Senior-level Full TimeUnited States13h ago
-
Senior Data Engineer (5307) USD 125K-180KAWS | Azure | CI/CD | Case design | Data ModelingHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeArlington, VA13h ago
-
Senior-level Full TimeWashington, D.C.13h ago
-
Principal GenAI Data Engineer USD 182K-260KArize Phoenix | Clustering | CrewAI | Data Engineering | Data IngestionEducation reimbursement | Health plans | Parental leave | Remote work | Retirement optionsSenior-level Full TimeUSA - Update Location R13h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Apache Kafka | Apache Spark | Artificial Intelligence | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R14h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNew York, New York, United States14h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAI Agents | AWS | Ad Exchanges | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeSan Francisco, California, United States14h ago
-
Principal Engineer - Data and Infrastructure, Remote USD 150K-200KAWS | Azure | C# | CI/CD | Container Orchestration401k match | Clinical employee reimbursement | Dental insurance | Educational assistance | Flexible work schedulesSenior-level Full TimeRemote, United States R15h ago
-
Software Engineer - Applied Science USD 180K-400KCausal Inference | Data Analysis | Data pipeline | Experimentation | IonicAsync interview process | Profitability | Remote-firstEntry-level Full TimeU.S. (Remote) R16h ago
-
Data Engineer USD 86K-176KApache Iceberg | Apache Kafka | Apache Spark | Batch Processing | ClickHouseSenior-level Full TimeArlington, VA17h ago
-
AI Engineer USD 100K-203KArtificial Intelligence | DevSecOps | GPU Inference | GPU Performance | GPU Performance OptimizationSenior-level Full TimeArlington, VA17h ago
-
AI Engineer USD 116K-243KCybersecurity | Deep learning | DevSecOps | GPU Inference | GPU inference optimizationSenior-level Full TimeArlington, VA17h ago
-
Data Pipelines | Deep learning | Experimentation | Machine Learning | Model DeploymentMid-level Full TimeSan Jose, California, United States20h ago
-
Data Pipelines | Deep learning | Experimentation | Machine Learning | Model ServingSenior-level Full TimeSan Jose, California, United States20h ago
-
Big Data | Data Engineering | Data Processing | Data Warehouse | Data discoveryDevelopment workshops | Hands-on experience | Industry exposure | Social eventsEntry-level InternshipSan Jose, California, United States20h ago
-
Forward Deployed Engineer IV, GenAI, Google Cloud USD 207K-300KAPIs | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …21h ago
-
Staff Software Engineer, AI/ML, Google Cloud AI USD 207K-300KAlgorithms | Audio Processing | Cloud platform | Data Processing | Data StorageSenior-level Full TimeSunnyvale, CA, USA21h ago
-
Staff Software Engineer, AI Engines 3P TPU Inference USD 207K-300KData Processing | Debugging | Distributed Computing | Fine Tuning | GPUSenior-level Full TimeMountain View, CA, USA21h ago
-
Senior Software Engineer, GenAI GCP Security USD 174K-252KC++ | Cloud platform | Computer Security | Data Processing | DebuggingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA21h ago
-
Data Reliability Engineer II USD 127K-173KAccess Control | Amazon RDS | Amazon Redshift | Amazon S3 | Apache AirflowMid-level Full TimeBasking Ridge, New Jersey1d ago
-
Data Engineering Lead USD 172K-225KAccess Control | Amazon Web Services | Apache Airflow | Apache Spark | Cloud platformSenior-level Full TimeWestlake, TX, United States1d ago