Data Engineer Senior - Big Data Platform Team
Dallas Innovation Center - Luna Rd (TX270), United States
USD 50K-185K Senior-level Full Time
Tasks
- Automate deployments, testing, and monitoring
- Build ETL ELT batch and real time frameworks
- Deploy and manage data workloads with container platforms
- Design data warehouse architecture and data modeling
- Design develop maintain scalable data pipelines
- Ensure data governance security compliance
- Implement CI CD pipelines for data engineering workflows
- Implement and optimize data lake table formats
- Lead consult on data warehouse integration and implementation
- Maintain technical documentation and support onboarding
- Monitor resource allocation and resolve bottlenecks
- Optimize spark job performance
- Provide technical leadership mentor junior engineers
Perks/Benefits
- 401k match
- Educational assistance
- Health savings account
- Life insurance
- Long-term disability
- Medical/Dental/Vision insurance
- Paid Holidays
- Paid vacation
- Pension plan
- Robust wellness program
- Short-term disability
- Stock purchase plan
Skills/Tech-stack
Apache Iceberg | Apache Spark | Apache Spark SQL | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Bitbucket | CI/CD | Data Governance | Data Lake | Data Lake Storage | Data Modeling | Data Warehouse | Distributed Systems | Docker | ELT | ETL | GitHub | Jenkins | Kubernetes | Logical data modeling | Object storage | OpenShift | Performance optimization | S3 | SQL | Security Compliance | Spark | Spark SQL | Terraform | Vulnerability Management
Education
Roles
Related jobs
-
Software Engineer, Data (L1) USD 75K-130KAI Platform | APIs | Apache Airflow | Apache Iceberg | Apache Spark401k match | Calm subscription | Career growth and learning opportunities | Commuter benefits options | Dental insuranceMid-level Full TimeAustin, TX8h ago
-
Machine Learning Research Engineer USD 161K-189KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | C++Flexible hybrid work model | Mental health counseling | Mentorship programs | Paid parental leave | Paid volunteer time offMid-level Full TimeNew York, US, New York12h ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Governance | Data Security401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …12h ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Cost Optimization | Column-Level Security | Cost Optimization | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …12h ago
-
Sr. Application Software Engineer, Data Analytics USD 160K-225KAngular | C# | CI/CD | Computer Vision | Continuous integrationExtended hours | Travel | Weekend workSenior-level Full TimeBastrop, TX13h ago
-
Mid-level Full TimeEl Segundo14h ago
-
Foundation Model Data, Software Engineer USD 213K-263KApache Beam | Apache Flume | C++ | CI/CD | Distributed Systems401k match | Baby bonding leave | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeMountain View, CA, USA; San Francisco, …14h ago
-
Senior-level Full TimeOnsite - Austin, TX14h ago
-
Senior Data Engineer USD 90K-110KAWS | Agile | Apache NiFi | Data Architecture | Data ModelingAutonomy | Flexible working hours | Global employee assistance programme | Online training videos | Teambuilding eventsSenior-level Full TimeNew York, United States15h ago
-
Data Platform Engineer USD 85K-120KAlembic | App Service | Azure | Azure App | Azure App Service401k match | Annual discretionary bonus program | Bereavement leave | Commuter spending accounts | Dental insuranceMid-level Full TimeChicago, IL (Downtown)15h ago
-
Robotics Test Engineer USD 100K-150KASan | Bitbucket Pipelines | C++ | CI/CD | DebuggingDirect hire | Mentorship | Ownership of test suitesMid-level Full TimeOnsite - Austin, TX16h ago
-
AI Engineer 1 - Compliance, Quality & Testing USD 80K-150KAI-assisted testing | CI/CD | Code review | Cypress | Defect Tracking401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC16h ago
-
Machine Learning Engineer, ML Flywheel USD 136K-173KC++ | Data Pipelines | Distributed Systems | ML Ops | Machine LearningAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid workMid-level Full TimeMountain View, CA, USA17h ago
-
Software Engineer, Applied AI USD 190K-280KContext engineering | Data Processing | Data Storage | Debugging | Docker401k match | Dental insurance | Health insurance | Hybrid work model | Professional developmentSenior-level Full TimeNew York City R17h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R17h ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R18h ago
-
Machine Learning Engineer, ML Resources USD 170K-216KC++ | Compute management | Dashboards | Debugging | Distributed SystemsAnnual bonus | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA18h ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R19h ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R19h ago
-
AI Engineer 1 - Platform Integration & AI/Data USD 80K-150KAWS | Agentic Systems | Backend Development | Backend Services | CI/CD401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC19h ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R19h ago
-
Senior Machine Learning Engineer, Agentic AI USD 163K-245KAI Observability | Agent systems | Autonomous Agents | Benchmark Datasets | Distributed SystemsHealth insurance | Life and disability insurance | Lifestyle Benefits Account | Mental health benefits | Paid time offSenior-level Full TimeBellevue, WA; Menlo Park, CA; New …19h ago
-
Staff Software Engineer, Data Engineering USD 208K-260KAWS | Agentic Systems | Apache Spark | Data Contracts | Data GovernanceCatered lunches | Generous vacation policy | In-office collaboration | Learning budget | Mobile phone stipendSenior-level Full TimeSan Francisco, CA, United States20h ago
-
Blob Storage | C# | C++ | Distributed Caches | Distributed Caching401k | Dental insurance | Flexible time off | Health insurance | Paid parental leaveSenior-level Full TimeAliso Viejo, California, United States20h ago
-
Access layers | Blob Storage | C# | Caching Strategies | Data access401k | Dental insurance | Health insurance | Paid parental leave | Unlimited Flex Time OffSenior-level Full TimeLos Angeles, California, United States20h ago