Cloud Data Engineer
Dallas, TX, 75219, USA
USD 117K-250K (estimate) Senior-level Full Time
Tasks
- Assess source systems and create metadata mappings
- Automate testing and monitoring
- Build scalable ETL and ELT pipelines
- Build star schemas and semantic models
- Create pipeline rule engine
- Design end to end data pipelines using Microsoft Fabric
- Develop metadata driven ETL models
- Implement RBAC sensitivity labeling and data governance
- Implement data deduping and data quality checks
- Ingest transform and store data in lakehouse or warehouse
- Integrate data from REST APIs GraphQL and gRPC
- Integrate knowledge graphs ontology and AI agents
- Maintain development and production environments
- Optimize Spark jobs and SQL queries
- Perform data profiling and data wrangling
- Use PowerShell and Bash scripts for VM operations
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agents | Azure | Azure DevOps | CI/CD | DB2 | ELT | ETL | GRPC | Git | GraphQL | Informix | Knowledge graph | LLM | Lakehouse | Linux | Linux Bash | MariaDB | Microsoft Fabric | Microsoft Purview | MySQL | Ontology | Oracle | PostgreSQL | Powershell | PySpark | Python | RBAC | REST API | SQL | SQL Server | Semantic Model | Sensitivity labeling | Spark | Star Schema | Warehouse | Windows VM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Research Engineer, Voice + Speech USD 200K-400KData Pipelines | LLM | Language Processing | Machine Learning | Model EvaluationDaily meals snacks | Disability benefits | Fertility benefits | Life insurance | Medical/Dental/VisionSenior-level Full TimeNew York City6h ago
-
Staff Research Engineer, Voice + Speech USD 200K-400KConversational AI | Data Pipelines | Deep learning | Information Retrieval | LLM DeploymentDaily lunches and snacks | Disability benefits | Fertility and family building benefits | Life insurance | Medical/Dental/Vision insuranceSenior-level Full TimeNew York City6h ago
-
Senior Research Engineer, Voice + Speech USD 200K-400KData Pipelines | Deep learning | Information Retrieval | LLM Deployment | Language ModelsDaily meals | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSan Francisco6h ago
-
API Gateway | AWS Glue | Access Control | Apache Airflow | Apache AtlasSenior-level Full TimeFAIRFAX, VA, United States6h ago
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R6h ago
-
Software/Embedded Systems Engineer USD 135K-158KAgile Development | C++ | Change Control | DoD Systems | Embedded SoftwareTravel 25%Senior-level Full TimeArlington, VA, United States6h ago
-
Data/ML Scientist SME USD 105K-150KAWS GovCloud | Anomaly Detection | Apache Spark | Bayesian Causal Inference | Bayesian MethodsMid-level Full TimeFAIRFAX, VA, United States6h ago
-
Lead AI Engineer USD 180K-280KCI/CD | ColBERT | Docker | Faiss | Fine Tuning401k match | Bonus | Childcare benefits | Dental insurance | Disability insuranceSenior-level Full TimeQuincy, MA, United States7h ago
-
API Integration | AWS | AWS Glue | Batch Processing | Code reviewSenior-level Full TimeIndianapolis, IN, United States R8h ago
-
Senior-level Full TimeUnited States8h ago
-
Senior-level Full TimeUnited States8h ago
-
Software engineer, generative AI USD 119K-292KAWS | Agentic Workflows | Asyncio | Azure | Docker401k | Cancer testing support | Company holidays | Company off-sites | Company stock optionsMid-level Full TimeSan Francisco, CA8h ago
-
AI engineer USD 152K-315KAWS | Azure | Cloud Computing | Deep learning | GCP401k | Company offsites | Dental insurance | Fertility support | Flexible spending accountMid-level Full TimeSan Francisco, CA9h ago
-
Computational Biologist - Protein Engineering USD 150K-250KAWS | Amazon Web Services | CUDA | Conda | Deep learningRelocation supportEntry-level Full TimeSan Francisco, CA, US9h ago
-
Entry-level Full TimeSan Francisco, CA, US9h ago
-
Applied Math Libraries Engineer (SPU) USD 120K-170KArithmetic intensity | Atomics | BLAS | Bandwidth) | C#Entry-level Full TimeRedwood City9h ago
-
Kernel Engineer — Scientific Computing (SPU) USD 120K-170KAtomic operations | C++ | CUDA | Concurrency | DebuggingEntry-level Full TimeRedwood City9h ago
-
Product Engineer USD 120K-200KAWS | FFmpeg | Next.js | Node.js | PostgreSQL401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsEntry-level Full TimeSan Francisco, CA, US9h ago
-
ADA | API Development | Application Programming | Application Programming Interface | C#Active secret clearanceSenior-level Full TimeAtlanta, Georgia10h ago
-
Senior Google Cloud Data Engineer USD 170K-240KAlerting | Anomaly Detection | Apache Beam | Apache PubSub | Batch Data ProcessingCareer advancement | Dental insurance | Health savings account | Hybrid work options | Medical insuranceSenior-level Full TimeNew York City11h ago
-
API Testing | Bash | C# | CI/CD | JUnitEntry-level Full TimePennsylvania, Exton11h ago
-
Senior Software Engineer, AI Coding Tools USD 244K-588KDeep learning | Fine Tuning | GPU | Inference acceleration | Language ModelsSenior-level Full TimeSan Jose, California, United States11h ago
-
Automated Orchestration | Backup and Restore | C# | C++ | CXLSenior-level Full TimeSeattle, Washington, United States11h ago
-
Software Engineer, Generative AI, Workspace USD 147K-211KC++ | Distributed Systems | Generative AI | Information Retrieval | Integration TestingBenefits | Bonus | EquityMid-level Full TimeBoulder, CO, USA12h ago
-
Software Engineer III, AI/ML Computer Vision, AR USD 147K-211KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan José, CA, USA12h ago