Data Engineer ID50062
Houston, United States
USD 148K-164K (estimate) Senior-level Full Time
Tasks
- Build AWS and on-prem infrastructure
- Build ingestion workflows from third party APIs
- Consult on technical requirements and roadmaps
- Design and build data lakehouses
- Design and build data lakes
- Design and build data warehouses
- Implement ETL ELT processes at scale
- Manage and optimize parquet avro and orc formats
- Optimize high performance data retrieval
- Orchestrate data pipelines
- Support machine learning initiatives
Perks/Benefits
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Avro | Columnar Storage | Data Ingestion | Data Lakehouse | DuckDB | ELT | ETL | Elasticsearch | GCP | Jupyter | Jupyter Notebook | Machine Learning | Medallion Architecture | NoSQL | ORC | OpenSearch | Pandas | Parquet | Polars | PySpark | Python | SQL | Snowflake | Terraform | Third Party | Third-party APIs
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Related jobs
-
AWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatch | Amazon EC2100 percent onsite | Onsite in McLean VASenior-level ContractMc Lean, United States3h ago
-
Senior-level ContractAustin, United States4h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States4h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeWest Palm Beach, United States4h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Advanced Analytics | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Remote work options | TechtalksSenior-level Full TimeJacksonville, United States4h ago
-
Data Engineer - TechCare Operations: Blueprint team USD 103K-174KAgile | DBMS | Data Architecture | Data Modeling | Database AdministrationCareer development and training | Company 401k match | Disability benefits | Employee counseling support | Financial coachingSenior-level Full TimeUS-Arizona-Phoenix4h ago
-
Senior AI Engineer USD 123K-215KAPI Design | API Versioning | AWS | Argo Workflows | Authentication & AuthorizationCareer development and training | Confidential counseling support | Employee wellness centers | Financial coaching | Health insuranceSenior-level Full TimeUS-Arizona-Phoenix4h ago
-
Data Engineer USD 117K-195KAWS | Cloud Security | Cloud infrastructure | Data Governance | Data LakesHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-Remote Work R5h ago
-
Behavior Modeling | Blended Ranking | Click Through Rate | Click Through Rate Prediction | Conversion RateSenior-level Full TimeSan Jose, California, United States5h ago
-
Research Engineer/Scientist (all levels), World Models USD 187K-359KCausal modeling | Computer Vision | Deep learning | Generative AI | Long ContextEntry-level Full TimeSan Jose, California, United States5h ago
-
Computer Vision | Context modeling | Generative AI | Long Context | Long Context ModelingSenior-level Full TimeSan Jose, California, United States5h ago
-
Senior Software Engineer, Full Stack - USDS USD 150K-180KAI tools | Agent workflows | Code Quality | Debugging | JavaScriptSenior-level Full TimeSan Jose, California, United States5h ago
-
Machine Learning Engineer, TikTok Brand Ads USD 187K-355KDeep learning | Embeddings | Hard Negative Mining | Inference Optimization | Information RetrievalSenior-level Full TimeSan Jose, California, United States5h ago
-
Research Engineer, Language USD 170K-251KData Processing | Deep learning | Distributed Systems | Efficient Inference | Efficient TrainingEntry-level Full TimeBurlingame, CA6h ago
-
AI/HPC Systems Performance Engineer USD 177K-276KC++ | Host Networking | IB | MPI | Machine LearningMid-level Full TimeMenlo Park, CA6h ago
-
Software Engineer, AI/ML, Geo Data Protection USD 147K-211KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalMid-level Full TimeMountain View, CA, USA6h ago
-
Software Engineer, AI/ML, Google Ads USD 174K-252KC plus plus | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsMid-level Full TimeMountain View, CA, USA6h ago
-
Accelerator Virtualization | Artificial Intelligence | Container Orchestration | Container Runtime | Distributed SystemsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA6h ago
-
Senior Software Engineer, Compiler Optimization USD 174K-252KC# | C++ | Compiler optimization | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Forward Deployed Engineer III, Applied AI, Google Cloud USD 183K-265KAPIs | Agent systems | Chain-of-Thought | Conversational AI | CrewAICollaboration with research and engineering experts | Direct access to DeepMind teams | High travelSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …6h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KC++ | Data Analysis | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA6h ago
-
Staff Software Engineer USD 207K-300KArtificial Intelligence | C++ | Computer Vision | Data Processing | Embedding ModelsSenior-level Full TimeMountain View, CA, USA6h ago
-
Application development | C++ | Data Analysis | Data Processing | Data Processing PipelinesMid-level Full TimeSunnyvale, CA, USA6h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Code review | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA6h ago