Data Platform Engineer
Tasks
- Analyze data for enterprise reporting and machine learning
- Build data ingestion and transformation workflows
- Design Big Data processing pipelines
- Document data engineering processes
- Implement reliable performant cost effective data platforms
- Ingest structured and unstructured data
- Operate analytics platforms on Hadoop
- Troubleshoot and debug data processing systems
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Iceberg | Apache Spark | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed Systems | Flink | HBase | HDFS | Hadoop | Hive | Hudi | Infrastructure as Code | Java | Kafka | Kubernetes | Oozie | Python | SQL | Scala | Shell | Spark Streaming | Sqoop | Trino | “as-code”
Education
N/A
Roles
Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Senior Machine Learning Engineer, Shield USD 211K-263KAnomaly Detection | Apache Spark | BigQuery | Cloud platform | DataflowSenior-level Full TimeRedwood City, CA, United States R13h ago
-
Senior Director, Data Platform Engineering USD 156K-225KAirflow | Ansible | Architecture | Batch Processing | CI/CDBonus program | Global perks | Health and wellness benefits | RSU equity programsSenior-level Full TimeUnited States R13h ago
-
Algorithms | Concurrency | Data Structures | ESQL | Elasticsearch401k matching | Donation matching | Flexible schedules | Health coverage | Parental leaveSenior-level Full TimeUnited States R15h ago
-
Forward Deployed AI Solutions Engineer USD 105K-132KAPIs | Auditability | Authentication | Command Line | Command-line Interface401k benefits | Baby bonding leave | Commuter benefits | Disability coverage | Employee referral programMid-level Full TimeUS Remote R15h ago
-
Staff Forward Deployed AI Solutions Engineer USD 152K-190KAPIs | Auditability | Auth | CLI | Cloud platform401k | Commuter benefits | Dental insurance | Disability insurance | Fertility care benefitsSenior-level Full TimeUS Remote R16h ago
-
Machine Learning Engineer USD 115K-150KBig Data | C++ | Data Aggregation | Data Preprocessing | Data ValidationDental insurance | Medical insurance | Retirement benefits | Telecommuting permitted | Vision insuranceNone Full TimeUnited States R16h ago
-
Data Curator USD 70K-88KAutomation | Business Analytics | Data Processing | Data Quality | Data ValidationMid-level Full TimeHybrid, US R16h ago
-
Senior-level Full TimeUS - Remote R17h ago
-
Sr. Bioinformatics Scientist USD 150K-189KAWS | AWS Batch | AWS Lambda | Analytical validation | BioinformaticsSenior-level Full TimeRemote ; South San Francisco, California, … R17h ago
-
Senior Data Platform Engineer USD 170K-230KAWS Lambda | Amazon EKS | Amazon EMR | Amazon Redshift | Amazon S3401k matching | Company events | Flexible paid time off | Health insurance | Home office stipendSenior-level Full TimeUnited States R18h ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Angular | Azure Databricks | CI/CD | Cloud platformRemote workMid-level Full TimeWork from home, VA, United States R19h ago
-
Senior Full Stack AI Developer USD 125K-185KApplication development | Batch | Cloud Engineering | Continuous Delivery | Continuous integrationHealth benefits | Remote workSenior-level Full TimeFairfax, VA, United States R19h ago
-
Senior Data Engineer (Remote) USD 120K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data RefreshEqual opportunity employer | Remote workSenior-level Full TimeUnited States R20h ago
-
Senior-level Full TimeRemote - US R20h ago
-
Analytics Engineer USD 110K-140KDBT | Data Modeling | ETL | Git | Python401k company match | Career advancement | Full medical, dental, and vision coverage | Gym membership stipend | Leadership trainingMid-level Full TimeColumbia, MO (Headquarters) R20h ago
-
Principal Data Engineer USD 220K-260KAirflow | Amazon EKS | Apache Spark | Astronomer | BigQuery401k employer matching | Comprehensive health benefits | Employee stock purchase program | Offsite team retreats | Parental leaveSenior-level Full TimeUS Remote R20h ago
-
Generative AI/LLM Engineer USD 105K-125KAPI Development | AWS | Azure | Chroma | Continuous DeploymentOnsite work with flexible remote daysMid-level Full TimeFrisco, TX, United States R20h ago
-
.NET | C# | CI/CD | Data Ingestion | Database partitioningCareer growth | Hybrid work model | In-office collaboration days | Remote work daysSenior-level Full TimeUSA - Atlanta, GA R20h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Integration | Automation | Backend Development | Production EngineeringCompetitive salary | Equity | Hybrid work environment | Unlimited PTOMid-level Full TimeKing of Prussia, PA, United States R21h ago
-
Senior Data Engineer USD 155K-175KApache Airflow | Argo CD | CI/CD | Data Integrity | Data ModelingAnnual bonus program | Comprehensive benefits package | Hybrid work environmentSenior-level Full TimeUnited States - Remote R21h ago
-
Senior Data Engineer USD 165K-165KCloud Native | Data Contracts | Data Governance | Data Lineage | Data ModelingCross regional team | Mission-driven | Remote-firstSenior-level Full TimeUnited States R23h ago
-
Software Engineer USD 149K-211KAlgorithms | C# | C++ | Code Reviews | Data ProcessingHybrid scheduleMid-level Full TimeSunnyvale, CA, USA R1d ago
-
Senior Research Engineer USD 174K-252KC++ | Data Curation | Deep Neural Networks | Deep learning | JAXBenefits | Bonus | Equity | Hybrid work scheduleSenior-level Full TimeNew York, NY, USA R1d ago
-
Research Engineer USD 147K-211KAlgorithm Design | C++ | Experimental Design | Machine Learning | PythonHybrid scheduleMid-level Full TimeLos Angeles, CA, USA R1d ago