Senior Data Engineer ID75059
Irving, United States
USD 156K-190K (estimate) Senior-level Full Time
Tasks
- Build data lakehouse architectures
- Build data warehouses
- Design data lakes
- Develop Python ETL/ELT pipelines
- Ingest data from third-party APIs
- Manage Parquet Avro ORC file formats
- Optimize SQL queries and data pipelines
- Optimize columnar storage
- Orchestrate workflows with Airflow
- Provision AWS on prem infrastructure with Terraform
- Translate business goals into data architecture roadmaps
- Troubleshoot data latency and consistency issues
- Work with Snowflake and Spark
Perks/Benefits
Skills/Tech-stack
AWS | Amazon S3 | Apache Airflow | Apache Spark | Avro | Big Data | Columnar Storage | Data Lake | Data Lakehouse | Data Warehouse | DuckDB | ELT | ETL | Elasticsearch | Medallion Architecture | ORC | OpenSearch | Pandas | Parquet | Polars | PySpark | Python | REST APIs | SQL | Scalability | Snowflake | Terraform
Education
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R7d ago
-
AWS | Bash | CI/CD | Collibra | Data Governance100 percent onsite | Onsite support in McLean VASenior-level ContractMc Lean, United States6h ago
-
Analytics & Reporting (SAP & Alteryx) USD 90K-150KAlteryx | Alteryx Designer | Alteryx Server | Data Analysis | Data BlendingMid-level Full TimeScott Air Force Base, United States6h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkSenior-level ContractSanta Monica, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeFort Lauderdale, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeRichmond, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeMiami, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeTexas City, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote work optionsSenior-level Full TimeBoca Raton, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | AWS SageMaker | Airflow | Apache SparkEducation budget | Exciting projects | Fitness budget | Flexible schedule with remote and office options | FlextimeSenior-level Full TimeBaltimore, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeJersey City, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Airflow | Avro | Big DataExciting projects | Flexible schedule | Flextime | Mentorship | Office optionsSenior-level Full TimeOrlando, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Scala | Apache SparkExciting projects | Flexible schedule | Global collaboration | Mentorship | Modern solutionsSenior-level Full TimeHouston, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeBlacksburg, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeDallas, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeWest Palm Beach, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | Cloud platformFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeAustin, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Avro | Big Data | Columnar StorageFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeLos Angeles, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePort Charlotte, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Professional growthSenior-level Full TimeAtlanta, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Apache Airflow | Apache Spark | Avro | BigQueryEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeJacksonville, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Apache Avro | Apache Jupyter | Apache ParquetFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBoston, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAPIs | AWS | Airflow | Apache Kafka | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthSenior-level Full TimeChicago, United States7h ago
-
Senior Data Engineer ID75059 USD 156K-190KAWS | Airflow | Apache Spark | Avro | Columnar StorageExciting projects | Flexible schedule | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeNew York, United States7h ago