Apache Iceberg Data Engineer
USA, VA, McLean (8283 Greensboro Dr, Hamilton), United States
USD 62K-141K Entry-level Full Time
Tasks
- Build data pipelines and workflows
- Debug and troubleshoot data lake consistency and performance
- Design and document reusable modular solutions
- Design and maintain scalable data lake platforms
- Develop and deploy data engineering pipelines
- Implement ETL and ELT processes
- Integrate query engines with Iceberg tables
- Manage data lake transactions and schema evolution
- Support data lifecycle management with time travel
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Glue Catalog | Access Control | Agile | Apache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Cloud Storage | Data Governance | Data Lake | Data Lake Storage | Data Versioning | Delta Lake | Docker | ELT | ETL | Glue Catalog | Google Cloud | Google Cloud Storage | HDFS | Hive Catalog | Hive Metastore | Java | Kafka | Kubernetes | Lakehouse | Partitioning | Presto | Python | Role-Based Access | Role-Based Access Control | S3 | Scala | Schema evolution | Time Travel | Time Travel Queries | Trino
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior-level Full TimeSalem, NH, United States6h ago
-
Senior-level Full TimeNew York, NY, United States6h ago
-
Sr. Java Full Stack Developer USD 103K-173KAPI Design | AWS | Ansible | Automated testing | BenchmarkingSenior-level Full TimeDallas, Texas, United States10h ago
-
Grid Analytics Researcher USD 86K-134KAPIs | Anomaly Detection | CAISO | Capacity expansion | Capacity expansion modeling401k employer match | Accident insurance | Commuter benefits | Education assistance | Fitness subsidyMid-level Full TimeHOUSTON(USA), HOUSTON, United States / US10h ago
-
LLM Post-Training Engineer, Research & Product USD 212K-389KData Pipelines | Deep learning | Distributed Training | Human preference learning | Instruction TuningSenior-level Full TimeSan Jose, California, United States11h ago
-
AI Specialist - Product and Applied Research USD 178K-235KArtificial Intelligence | C++ | Computer Vision | Data Mining | Data RegressionMid-level Full TimeMenlo Park, CA | New York, …12h ago
-
Image Processing Engineer USD 141K-203KASIC | C++ | Co-design | Computational imaging | Computer VisionSenior-level Full TimeSunnyvale, CA12h ago
-
Senior Software Engineer, AI/ML, AI and Infrastructure USD 174K-252KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Software Engineer III, AI/ML, Google Workspace USD 147K-211KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Cloud platform | Data Preparation | Data ProcessingSenior-level Full TimeKirkland, WA, USA12h ago
-
Staff Software Engineer, Generative AI, Google Cloud AI USD 207K-300KArtificial Intelligence | Cloud platform | Computer Vision | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA12h ago
-
Senior Software Engineer, AI/ML, Google Cloud Compute USD 174K-252KC++ | Data Processing | Debugging | Distributed Computing | Language ProcessingSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Senior Software Engineer, AI/ML GenAI, Search USD 174K-252KAlgorithms | C++ | Code review | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA12h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KC++ | Computer Vision | Data Processing | Data Storage | DebuggingSenior-level Full TimeMountain View, CA, USA12h ago
-
Software Engineer, BigQuery AI/ML USD 147K-211KArtificial Intelligence | BigQuery | C plus plus | Cloud platform | Compute TechnologiesMid-level Full TimeKirkland, WA, USA12h ago
-
Software Engineer III, AI/ML, AI and Infrastructure USD 147K-211KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Software Engineer, Cloud AI, Agent Infrastructure USD 147K-211KAgent Orchestration | C++ | Cloud platform | Data Processing | Data StorageMid-level Full TimeSunnyvale, CA, USA12h ago
-
Artificial Intelligence | C plus plus | C# | Computer Vision | Data PipelinesMid-level Full TimeNew York, NY, USA; Mountain View, …12h ago
-
Lead Data Engineer - IT USD 105K-152KApache Spark | BW/4HANA | Business Data Cloud | CDS Views | Data GovernanceAdoption Assistance | Education assistance | Health and life insurance | Paid time off | Peer recognitionSenior-level Full TimeLibertyville, IL, US, 60048-378117h ago
-
Robotics Test & Data Engineer, Mapping USD 70K-300K3D Point Cloud Processing | 3D point cloud | Bash | Cloud processing | Cloud validationMid-level Full TimeIrvine, CA20h ago
-
Senior-level Full TimeSan Francisco, US20h ago
-
Senior-level Full TimeUSA - Atlanta, GA; USA - …22h ago
-
Senior Software Engineer - System Optimization USD 119K-258KBenchmarking | C# | C++ | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, US; Redmond, WA, …22h ago
-
AWS | C# | Cloud Native | Data Engineering | DeploymentSenior-level Full TimeSouth San Francisco, United States23h ago