Cloud Data Engineer
Dallas, TX, 75219, USA
USD 117K-250K (estimate) Senior-level Full Time
Tasks
- Assess source systems and create metadata mappings
- Automate testing and monitoring
- Build scalable ETL and ELT pipelines
- Build star schemas and semantic models
- Create pipeline rule engine
- Design end to end data pipelines using Microsoft Fabric
- Develop metadata driven ETL models
- Implement RBAC sensitivity labeling and data governance
- Implement data deduping and data quality checks
- Ingest transform and store data in lakehouse or warehouse
- Integrate data from REST APIs GraphQL and gRPC
- Integrate knowledge graphs ontology and AI agents
- Maintain development and production environments
- Optimize Spark jobs and SQL queries
- Perform data profiling and data wrangling
- Use PowerShell and Bash scripts for VM operations
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agents | Azure | Azure DevOps | CI/CD | DB2 | ELT | ETL | GRPC | Git | GraphQL | Informix | Knowledge graph | LLM | Lakehouse | Linux | Linux Bash | MariaDB | Microsoft Fabric | Microsoft Purview | MySQL | Ontology | Oracle | PostgreSQL | Powershell | PySpark | Python | RBAC | REST API | SQL | SQL Server | Semantic Model | Sensitivity labeling | Spark | Star Schema | Warehouse | Windows VM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data engineer , Machine Learning USD 170K-240KApache Airflow | Apache Spark | Audio Data | Coverage monitoring | DagsterEmployee Assistance Program (EAP) | Employer matching 401k | Health, dental, vision insurance | Unlimited PTOMid-level Full TimeSan Francisco3h ago
-
Senior Data Engineer USD 160K-207KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Equity | Family planning resources | Flexible vacation daysSenior-level Full TimeRemote - USA R6h ago
-
Machine Learning Engineer USD 138K-183KAWS | Airflow | Amazon Redshift | Amazon SageMaker | Apache Flink401k retirement savings | Health care insurance | Occasional travel for meetings | Paid parental leave | Paid sick timeMid-level Full TimeRemote - US R6h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | DBT | Data Governance | Data Modeling | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R8h ago
-
Senior Software Engineer, Data Engineering USD 164K-227KAWS | AWS Glue | Amazon EMR | Amazon Redshift | Apache Airflow401k match | Backup Child Care | Backup elder care | Backup pet care | Chime days paid time offSenior-level Full TimeSan Francisco, CA, USA9h ago
-
Sr Analyst, Data Engineer USD 76K-143KAPI Integration | AWS | Agile | Batch Processing | CI/CD401k match | Business Casual Attire | Dental insurance | Health insurance | Hybrid work optionSenior-level Full TimeOhio - Columbus, Three Nationwide Plaza, … R9h ago
-
Software Engineer - Voice AI (Inference Runtime) USD 165K-330KAPI Development | CLI Development | Docker | Kubernetes | Language Processing401k matching | Fertility and family building stipend | Flexible PTO | Medical, dental, and vision insurance | Paid parental leaveSenior-level Full TimeSan Francisco10h ago
-
AI Search | AWS | AWS Bedrock | Azure | Azure AI401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States10h ago
-
Full Stack Software Engineer, Applied AI USD 140K-140KAPI Design | Alerting | CI/CD | Cloud infrastructure | DevOpsFlexible PTO | Health insurance | Mental wellness days | Paid Holidays | Parental leaveMid-level Full TimeSan Francisco10h ago
-
Staff Machine Learning Engineer, Developer Platform USD 230K-322KA/B | A/B Testing | AWS | Automation | B testingCoaching benefits | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R11h ago
-
Autonomy and Robotics Software Engineer USD 125K-220KC++ | CI/CD | Classification | Computer Vision | Dataset versioningE-Verify enrollment | Health insurance | Professional development | Retirement plansMid-level Full TimeHuntington Beach11h ago
-
Senior Data Platform Engineer, Remote USD 142K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatch401k matching | Dental insurance | Flexible time off | Flexible work environment | Medical insuranceSenior-level Full TimeUnited States, UNITED STATES, United States R11h ago
-
Intern, Mission Optimization Engineer USD 70K-120KAgile | Bash | CI/CD | Datadog | DockerAccess to LinkedIn Learning | Commuter benefits | Internet reimbursement | Paid time offEntry-level InternshipSan Francisco, CA R11h ago
-
Autonomy and Robotics Software Engineer USD 125K-220KC++ | CI/CD | Embedded Systems | Fault detection | GNSSHealth insurance | Professional development | Retirement plansMid-level Full TimeHuntington Beach11h ago
-
Forward Deployed Engineer - Applied AI USD 150K-210KAPI Development | Artificial Intelligence | Automation | Deployment | JavaScriptFast-paced team | High ownership culture | High-impact work | Travel opportunitiesSenior-level Full TimeGallup, New Mexico, United States; Michigan, …11h ago
-
Early Career Software Engineer – Applied AI USD 100K-120KAWS | Cloud Computing | Cloud platform | Google Cloud | Google Cloud PlatformFlexible PTO | Lunch covered | Mental wellness days | Parental leave | Wellness reimbursementsEntry-level Full TimeSan Francisco11h ago
-
Lead Consultant Data Engineer USD 142K-175KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure FabricCare Com Membership | Dental benefits | Equipment replacement program | Flexible work | Health savings accountSenior-level Full TimeArlington, Virginia, United States, Remote R11h ago
-
Staff Data Engineer USD 165K-207KAWS | Agile | Amazon Athena | Amazon QuickSight | Amazon Redshift401k | Commuter benefits | Dental insurance | Disability insurance | Fertility care benefitsSenior-level Full TimeUS Remote R11h ago
-
Chaos Engineering | Distributed Systems | Fault injection | Linux | Load TestingFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA12h ago
-
Altera | FPGA | IP | Modelsim | PythonMid-level Full TimeChicago12h ago
-
Algorithms | Data Structures | Distributed Systems | Linux | NetworkingEntry-level Full TimeChicago12h ago
-
Algorithms | Data Structures | Distributed Systems | HPC | High PerformanceMid-level Full TimeChicago, New York, Amsterdam12h ago
-
Senior Staff ll, Machine Learning Engineer (Tech Lead) USD 187K-322KA/B | A/B Testing | B testing | Big Data | C++401k plan | Dental insurance | Disability insurance | Electric car charging | Employee assistance programSenior-level Full TimeMountain View, USA13h ago
-
Staff Machine Learning Engineer - Search USD 159K-208KAWS | Airflow | Autocomplete | Automation | Azure401k matching | Commuter benefits | Fitness benefits | Health insurance | Mental health supportSenior-level Full TimeAtlanta13h ago
-
Staff Machine Learning Engineer - Search USD 159K-208KAWS | AWS OpenSearch | Apache Airflow | Apache Flink | Apache Kafka401k match | Commuter benefits | Fitness benefits | Health insurance | Mental health supportSenior-level Full TimeNew York City13h ago