Senior Big Data Engineer
United States - Remote
R
A USD 120K-150K (estimate) Senior-level Full Time
Tasks
- Build and optimize data pipelines
- Collaborate with cross-functional teams
- Communicate technical concepts to stakeholders
- Design ETL/ELT pipelines
- Develop data transformation solutions using Python
- Implement data validation and error handling
- Integrate and automate data workflows
- Monitor pipeline health and traceability
- Parse transform and validate XML data
- Participate in Agile planning and documentation
- Troubleshoot pipeline failures and data issues
- Use Linux shell scripting for scheduled jobs
- Write and optimize SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon RDS | Amazon Redshift | Cron | Data Modeling | Data Validation | ELT | ETL | Error Handling | Java | Linux | Microstrategy | Monitoring | Oracle | PostgreSQL | Power BI | Python | SQL | Shell Scripting | Stored Procedures | XBRL | XML
Education
Roles
Related jobs
-
AI/Machine Learning Engineer USD 99K-225KAPI Integration | AWS | Agentic Workflows | Azure | CrewAI401k Company Contributions | Career development | Company funded HRA | Employer-paid life insurance | Long-term disabilityMid-level Full TimeFt. Meade, MD; Laurel, MD R14h ago
-
Apache Spark | Azure Synapse | DAX | Data Lake | Data ModelingBirthday day off | Life insurance | Prepaid medicine | Work from homeMid-level Full TimeColombia, United States R18h ago
-
Load Forecasting Data Scientist USD 86K-120KBig Data | Data Wrangling | Data munging | Data pipeline | Geospatial AnalyticsEmployee assistance program | Flexible work hours | Hybrid work environment | Paid time off | Professional developmentMid-level Full TimeWindsor, CT, 06095, USA R23h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R1d ago
-
Software Engineer, Data Plane Hybrid USD 147K-237KAgile | C# | C++ | Cloud Native | Cloud Native Network Function CNFSenior-level Full TimeWESTFORD, United States R1d ago
-
AI Engineer USD 140K-182KCaching | Embeddings | Error Recovery | Evaluation | Fallback LogicCollaborate with small fast moving team | Competitive equity | Direct ownership | Full-time employment | Hybrid workMid-level Full TimeNew York, New York, United States R1d ago
-
Senior Data Engineer II USD 145K-207KAirflow | Alerting | BigQuery | CI/CD | CloudMeaningful greenfield work | Onsite visits up to four times per year | Remote work within United States | Work-life balanceSenior-level Full TimeUnited States - Remote R1d ago
-
Principal Solutions Engineer, Data & AI USD 175K-200KAPIs | CRM | Databricks | Delta Sharing | HIPAA401k | Company on site visits | Dental insurance | Fully remote | Health and wellness stipendSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Engineer USD 170K-210KAWS | AWS Neptune | Amazon Kinesis | Apache Airflow | Apache FlinkDental insurance | Family leave | Flexible paid time off | Free food and snacks | Health care planSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Senior Agentic (AI) Engineer USD 160K-200KA/B | A/B Testing | AWS | Agent SDK | ArgoCDDental insurance | Family leave | Flexible paid time off | Free food and snacks | Health insuranceSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Databricks Lakehouse Engineer and Analyst, Mid USD 77K-176KAccess Control | Artificial Intelligence | Databricks | Delta Lake | HadoopDependent care | Health insurance | Paid leave | Professional development | Retirement benefitsMid-level Full TimeUSA, VA, McLean (8251 Greensboro Dr), … R1d ago
-
Data Visualization Engineer USD 62K-141KArtificial Intelligence | Dashboard Development | Data Quality | Data Transformation | Data VisualizationDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, CA, Monterey (20 Ryan Ranch … R1d ago
-
Robotics Autonomy Engineer USD 77K-176KAgent systems | Architecture development | C plus plus | CI/CD | CameraMid-level Full TimeUSA, CA, San Diego (1615 Murray … R1d ago
-
AI/ML Software Developer USD 69K-158KAWS | Azure | C++ | Computer Vision | Deep learningDependent care | Health benefits | Paid leave | Professional development | Retirement benefitsMid-level Full TimeUSA, MD, Fort Meade (9800 Savage … R1d ago
-
Senior Machine Learning Engineer I USD 150K-241KAWS | Azure | Batch Processing | Data Pipelines | Data labelingDental insurance | Emotional wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R1d ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R1d ago
-
Site Reliability Engineer - Ceph Storage USD 128K-192KAnsible | Block devices | CRUSH | Cause analysis | CephEmployee stock purchase plan | Generous time off | Healthcare benefits | Parental leave | Remote work optionsSenior-level Full TimeUnited States R1d ago
-
ARINC 429 | ARINC 653 | C plus plus | C# | CAN401k match | Dental insurance | Disability insurance | Educational assistance | Employee assistance programMid-level Full TimePhoenix, AZ, United States R1d ago
-
Senior Data Engineer USD 140K-170KAPIs | Azure DevOps | DBT | Data Architecture | Data GovernanceDiscretionary bonus | Hybrid work schedule | Training and developmentSenior-level Full TimeNew York, New York, United States R1d ago
-
Staff Software Engineer, Storage Services USD 177K-364KAI | C plus plus | Capacity Planning | Consensus | Distributed SQLSenior-level Full TimeNew York, NY, US; Remote, US R1d ago
-
Staff Software Engineer, Data Warehouse Foundation USD 177K-364KApache Airflow | Apache Flink | Apache Spark | Apache Superset | Data PipelinesSenior-level Full TimePalo Alto, CA, US; Remote, US R1d ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R1d ago
-
SAP Datasphere Integration Engineer USD 173K-306KAPI Integration | AWS | Amazon Redshift | Business Technology Platform | CDS Views401k | Dental insurance | HSA | Medical insurance | Paid time offSenior-level Full TimeUSA R1d ago
-
Senior Data Engineer- People Analytics USD 180K-207KAccess Control | Airflow | Amazon Redshift | CI/CD | Cloud platformSenior-level Full TimeUnited States R1d ago