Sr. Software Engineer
US - Texas - Austin Domain North, United States
R
USD 115K-153K (estimate) Senior-level Full Time
Tasks
- Build ETL pipelines
- Collaborate with service team to improve reliability
- Create Spark data frames and RDDs
- Debug and resolve production data issues
- Design and develop EMR data pipelines
- Evaluate ETL architectures and technologies
- Implement data quality checks
- Load data to data lake
- Map source systems to target platform
- Monitor production issues
- Optimize Spark jobs
- Support customer data requests
- Work in scaled agile methodologies
Perks/Benefits
- 401k matching program
- Dental insurance
- Medical insurance
- Paid time off
- Telecommuting
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AWS Data | AWS Data Pipeline | AWS Glue | Amazon EC2 | Amazon RDS | Amazon S3 | Amazon SQS | Amazon Web Services | Apache Hadoop | Apache Hive | Apache Kafka | Apache NiFi | Apache Spark | Avro | CSV | Data Quality | Data pipeline | Databricks | Debezium | HDFS | JSON | Parquet | PySpark | Python | SQL Server | Snowflake | Web Services | YARN
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Research Engineer, SysML - FAIR USD 141K-208KAgent Orchestration | Bias Mitigation | C# | C++ | CUBLASMid-level Full TimeMenlo Park, CA | Remote, US R10h ago
-
AI Foundry | AWS Bedrock | Agent Frameworks | Agent Orchestration | AnthropicMid-level Full TimeHouston, TX, United States R17h ago
-
Embedded Semiconductor Engineer USD 120K-150KAutomation | BSP | C# | C++ | CloudCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Staff Data Engineer, Corporate Engineering USD 180K-252KAWS S3 | Automated reconciliation | CI/CD | Cloud Data | Cloud Data Warehouse401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsSenior-level Full TimeRemote - United States R1d ago
-
Senior AI Systems Engineer USD 130K-195KAlerting | Bash | CI/CD | CMMC | Configuration ManagementHybrid work option | Remote work optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R1d ago
-
Senior AI Technologist USD 145K-208KAI Agents | AI Foundry | AWS Bedrock | Apache Airflow | Apache SparkCross-functional collaboration | Fully remote or hybrid or onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R1d ago
-
Senior Analytics Engineer USD 73K-165KAgile | Apache Airflow | DBT | Data Governance | Data Mining401k plan | Flexible time off | Mental health resources | Remote work optionsSenior-level Full TimeRemote, US R1d ago
-
Data Engineer USD 120K-150KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CDSenior-level Full TimeRemote, United States R1d ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | Mentorship opportunities | On-call supportSenior-level Full TimeOrlando, FL, United States R1d ago
-
Senior Data Engineer – Hardware & Supply Chain USD 147K-203KAWS | Apache Iceberg | DBT | Data Governance | Data ModelingFlexible wellness time off | Paid Holidays | Paid sick leave | Paid time off | Parental leaveSenior-level Full TimeHybrid - San Francisco, California R1d ago
-
Principal Database Engineer USD 102K-203KASH | AWR | AWS IAM | AWS KMS | AWS RDSFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R1d ago
-
Computational Scientist USD 90K-105KC++ | Documentation | Fortran | HPC clusters | LinuxConference attendance | Open source contributions | Professional development opportunities | Student mentoringEntry-level Full TimeBlacksburg, Virginia, Hybrid R1d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k plan | Charity programs | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States R1d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R1d ago
-
Senior Machine Learning Engineer II USD 156K-250KAWS | Azure | Batch Processing | Container Orchestration | Data PipelinesDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
AI orchestration | Alerting | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Savings plan options | Vision insuranceSenior-level Full TimeSan Francisco, CA, United States R1d ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Alerting | Batching | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Remote work | Savings planMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Security Operations AI Engineer, Contract USD 151K-225KAI Governance | AI RMF | AI Security | Adversarial Attacks | Adversarial Machine LearningMid-level Full TimeRemote, United States R1d ago
-
Data Engineer USD 97K-122K.NET | API Development | API Gateway | AWS | AWS Glue401k match | Commuter benefits | Dental insurance | Dependent Care Savings Account | Education assistanceMid-level Full TimeRemote, United States R1d ago
-
AWS | Alerting | Azure | BigQuery | CI/CDEquity opportunities | Fully remote within Canada | Health, dental, vision coverage | Paid parental leave | Performance-Based IncentivesSenior-level Full TimeCanada R1d ago
-
API Design | Background Processing | CI/CD | Celery | DockerFully remote within Canada | High autonomy | High impact AI strategy involvementSenior-level Full TimeCanada R1d ago
-
ASAM OpenX | CARLA | Computer Vision | Data Curation | Diffusion ModelsFlexible location | Remote workSenior-level Full TimeUnited States Home Office, United States R1d ago
-
Principal Data Engineer USD 160K-170KAWS | Amazon Redshift | Apache Airflow | BigQuery | Cloud platform401k match | Dental insurance | Health insurance | Paid time off | Remote workSenior-level Full TimeRemote (United States) R1d ago
-
AI/ML Engineer - School USD 101K-163KAI Safety | AI safety evaluation | AWS Bedrock | AWS ECS | AWS LambdaMid-level Full TimeVirtual US IL, United States R1d ago