Lead Data Integration Engineer
USA-TX-Flexible Location, United States
R
USD 187K-187K Senior-level Full Time
Tasks
- Automate pipeline build testing and code migrations
- Build SQL processes for data curation
- Build data validation and curation frameworks
- Design and develop ETL/ELT pipelines
- Design data ingestion frameworks
- Develop data quality models
- Identify gaps in requirements
- Prepare data for consumption
- Translate requirements into data integration design
Perks/Benefits
- N/A
Skills/Tech-stack
Analysis Services | Apache Hive | Apache Spark | Apache Tez | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Azure Stream | Azure Stream Analytics | Cassandra | Cloud Storage | Cosmos DB | Data Factory | Data Ingestion | Data Lake Storage | Data Modeling | Data Quality | Data Services | Data Warehouse | Data Warehousing | Databricks | Databricks SQL | ELT | ETL | Elasticsearch | Google Cloud | Google Cloud Storage | Greenplum | HANA | HDFS | MapReduce | Metadata Driven | Metadata Driven Frameworks | MongoDB | NoSQL | Oracle | Pig | PostgreSQL | Python | Redis | SAP BusinessObjects | SPSS | SQL | SQL Data Warehouse | SSAS | SnowSQL | Snowflake | Snowpipe | Spark SQL | Stream Analytics | Teradata | Watson Analytics
Education
Related jobs
-
Senior Data Engineer-JT0224 USD 120K-183K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R3h ago
-
Business Data Engineer USD 140K-170KAPIs | AWS | Data Automation | Data Ingestion | Data PipelinesFlexible working hours | Vacation policyMid-level Full TimeSan Jose, California or Remote R15h ago
-
Senior Software Engineer - Data Platform USD 115K-145KAWS | Apache Airflow | Apache Spark | Azure | CI/CD401k plan | Coaching therapy professional development | Flexible spending account | Flexible vacation policy | Healthcare coverageSenior-level Full TimeUnited States R17h ago
-
Database Engineer, Senior USD 120K-150KClustering | Database debugging | Database performance | Database performance tuning | High AvailabilityOn-call rotationSenior-level Full TimeUSA - Remote, PA, US R19h ago
-
Data Engineer USD 83K-158KAngular | Continuous Delivery | Continuous integration | Data Visualization | Data WarehousingMid-level Full TimeTwo Destiny Way, Westlake TX, United … R19h ago
-
Staff Machine Learning Engineer USD 172K-306KA/B | A/B Testing | Approximate Nearest Neighbor | Approximate Nearest Neighbors | B testingSenior-level Full TimeSan Jose, United States R19h ago
-
Manager, Data Analytics USD 82K-136KArtificial Intelligence | Budgeting | Data Lineage | Data Quality | Data ReconciliationSenior-level Full TimeFlagship, United States R19h ago
-
Analytics Engineer, GFCO Analytics USD 152K-179KApache Airflow | Business Intelligence | DBT | Data Governance | Data ModelingQuarterly in person working sessions | Remote-first work environmentMid-level Full TimeRemote - USA R19h ago
-
Data Scientist / ML Engineer USD 170K-210KAWS | Azure | Bias Evaluation | Cloud Computing | Cloud platformFlexible working hours | Remote workSenior-level Full TimeNew York, NY, US, Remote R21h ago
-
Software Engineer, Data Engineering USD 153K-196KC# | C++ | Data Quality | Data pipeline | ETLCross-functional collaboration | Mentorship | OwnershipEntry-level Full TimeSan Mateo, CA, United States R22h ago
-
Machine Learning Engineer USD 138K-183KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkCorporate Bonus Plan | Equity plan | Generous time off | Healthcare | Paid personal time offMid-level Full TimeRemote - US R22h ago
-
Senior Data Platform Engineer USD 135K-180KCI/CD | Coalesce | Dagster | Data Modeling | Data pipeline401k match | Dental insurance | Flexible spending account | Flexible time off | Health insuranceSenior-level Full TimeHybrid in Texas R23h ago
-
Part-time NGS Data Quality Engineer USD 60K-70KAnalytical Skills | Chrome | Data Analysis | Data Mapping | Data QualityFlexible part-time hours | Remote work on SundaysNone Part TimeUnited States R23h ago
-
Data Solutions Engineer - Hybrid/Durham,NC USD 120K-153KADLS Gen2 | Alerting | Azure | Azure Data | Azure Data Factory401k matching | Employee referral program | Flexible spending account | Health savings account | Medical/dental/vision/life insuranceEntry-level Full TimeDurham, North Carolina, United States R23h ago
-
Staff AI Engineer USD 170K-220KAdversarial Benchmarking | Agent Frameworks | Asynchronous programming | CI/CD | Caching401k employer match | Continuous learning opportunities | Health, dental & vision plans | Hybrid work options | Paid parental leaveSenior-level Full TimeMiami, New York, San Francisco, US R23h ago
-
A/B | A/B Testing | Apache Spark | B testing | CalibrationCommuter benefits | Dental insurance | Disability insurance | Healthcare | Hybrid work scheduleSenior-level Full TimeRedwood City, US R1d ago
-
Lead Product Manager (Data Platform) USD 129K-186KAgile | Capital management | Data analytics | Enterprise SaaS | Feature FlagsPerformance bonuses | Restricted stock units | Travel opportunities | Work flexibilitySenior-level Full TimeUnited States R1d ago
-
AWS | Code review | Data Storage | Distributed Systems | KotlinEmployee stock purchase plan | Flexible spending wallets | Remote-first | Time offMid-level Full TimeRemote US R1d ago
-
Associate Data Solutions Engineer USD 95K-162KAI workflows | Apache Iceberg | DBT | Data Governance | Data Modeling401k with employer match | Advancement opportunities | Flexible spending account | Health benefits package | Long-term disability insuranceMid-level Full TimeUS-Remote R1d ago
-
Early-Career Network Engineer (RAN Optimization) USD 82K-128K4G | 5G | Automation | C Band | CBRSEducational assistance | Matching gifts | Paid sick time | Paid vacation | Parental leaveMid-level Full TimePlano,Texas,United States R1d ago
-
Artificial Intelligence/Machine Learning Engineer USD 119K-200KAKS | Anomaly Detection | Artificial Intelligence | Azure Data | Azure Data FactoryHybrid work | Remote workSenior-level Full TimeAustin, TX, United States R1d ago
-
Senior Research Data Engineer (US) USD 150K-200KAirflow | Dagster | Data Drift | Data Generation | Data LakeSenior-level Full TimeRemote - US R1d ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R1d ago
-
Data Engineer-M-F, 9am-6pm Pacific Time zone USD 80K-112KData Governance | Data Mining | Data Pipelines | Data Quality | Data Security401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeRemote, United States R1d ago
-
Data Engineer USD 110K-160KAPI Integration | Agile | Apache Kafka | Apache Spark | Application Performance Monitoring401k match | Family support programs | Fertility assistance | Hybrid work eligibility | Paid HolidaysMid-level Full TimePlano, TX, United States R1d ago