Senior Data Engineer
Austin Technical Center - Austin Technical Center, United States
USD 125K-173K Senior-level Full Time
Tasks
- Automate infrastructure with Terraform
- Build batch and streaming workflows with Databricks
- Build real time data processing with Kafka and Azure Event Hub
- Create observability with Prometheus and Datadog
- Deploy scale manage services on Azure Kubernetes Service
- Design build support data engineering pipelines
- Design relational data models and database performance
- Develop backend services with reliability observability maintainability
- Implement CI/CD pipelines with GitHub Actions
- Implement cron based and event driven orchestration
- Implement resiliency patterns and durable fixes
- Improve load testing capacity planning and performance
- Integrate enterprise data via REST APIs and messaging
- Manage GitOps deployments with ArgoCD
- Mentor and coach engineers
- Monitor metrics logs traces dashboards alerts
- Perform code reviews testing documentation security monitoring
- Troubleshoot production issues conduct root cause analysis
Perks/Benefits
- Employee assistance program
- Flexible spending accounts
- Health savings account
- Paid vacation and holidays
- Relocation benefits
- Retirement savings plan
- Tuition assistance programs
Skills/Tech-stack
AKS | Apache Spark | ArgoCD | Azure | Azure Event | Azure Event Hub | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Capacity Planning | Database performance | Database performance tuning | Databricks | Datadog | Distributed tracing | Docker | Encryption | Event Driven | Event Hub | Event-driven architecture | GitHub Actions | GitOps | Infrastructure as Code | Java | Kafka | Kubernetes | Kubernetes Service | Load Testing | Microservices | OAuth | Observability | OpenID Connect | Performance Tuning | PostgreSQL | Prometheus | Quarkus | Query Optimization | REST APIs | Relational databases | Secrets management | Spring Boot | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Data Engineer USD 128K-161KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake401k match | Hybrid work schedule | Paid time off | Parental leaveSenior-level Full TimeBloomington, MN, United States6h ago
-
Senior Data Engineer USD 100K-160KAI Services | API Integration | AWS CloudWatch | AWS Glue | AWS IAMEmployee assistance program | Hybrid work flexibility | Paid time off | Relocation assistance not available | Retirement savings planSenior-level Full TimeDallas, TX, United States8h ago
-
Sr. Full Stack AI Developer (St. Louis) USD 106K-133KAVA | Cloud Foundry | Codefresh | DRY | Docker401k matching | Bereavement leave | Employee assistance program | Employee discount program | Health, dental, and vision careSenior-level Full TimeSt. Louis, MO, United States10h ago
-
Sr. Full Stack AI Developer (St. Louis) USD 106K-133KAVA | Acceptance Testing | Agile | CI/CD | Cloud Foundry401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeSt. Louis, MO, United States10h ago
-
Infrastructure Engineer - Storage USD 100K-120KAI tools | Ansible | Azure | Azure Blob | Azure Blob Storage401k matching | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programMid-level Full TimeSt. Louis, MO, United States10h ago
-
Data Engineer-Secret Clearance Required USD 100K-150KAWS | AWS Glue | Amazon Redshift | Azure | Azure Data401k matching | Bereavement | Employee assistance program | Health, dental, vision coverage | HolidaysSenior-level Full TimeRemote - Nationwide, United States R10h ago
-
API Gateway | Azure | BI Cloud Connector | BI Cloud Connector Console | BI Publisher401k matching | Bereavement | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R10h ago
-
Sr. Full Stack AI Developer USD 106K-133KAVA | Acceptance Testing | Agents | Agile | CI/CD401k plan with company matching | Bereavement | Employee assistance program | Employee discount program | Health, dental, and vision careSenior-level Full TimeSt. Louis, MO, United States10h ago
-
Sr. Full Stack AI Developer USD 106K-133KAI integration | AVA | Acceptance Testing | Agents | Agile401k plan with company matching | Bereavement | Employee assistance program | Employee discount program | Health dental vision careSenior-level Full TimeSt. Louis, MO, United States10h ago
-
A/B Testing | AI Studio | Adobe Analytics | Airflow | Amazon SageMaker401k | Dental insurance | Medical insurance | Paid Holidays | Paid parental leaveSenior-level Full TimeDallas, Frisco13h ago
-
API Integrations | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Mid-level ContractLos Angeles, United States14h ago
-
Lead Data Expert USD 97K-163KData Architecture | Data Automation | Data Modeling | Data Quality | Data VisualizationOnsite 30 to 50 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States15h ago
-
Senior Software Engineer - AI Inference USD 160K-240KBatching | CUDA | Caching | Distributed Systems | High Performance401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York15h ago
-
Senior Software Engineer, AI/ML, Google Public Sector USD 174K-252KAlgorithms | C++ | Cloud Object Storage | Data Structures | Distributed ComputingSenior-level Full TimeReston, VA, USA16h ago
-
Staff Software Engineer, Intelligent Database Management USD 207K-300KAI | API Design | AlloyDB | Audit Logging | BigtableSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA16h ago
-
Forward Deployed Engineer I, GenAI, Google Cloud USD 102K-145KAPI Development | Agent Framework | Agent systems | Cloud Computing | CrewAISenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …16h ago
-
Senior Data Engineer USD 140K-165KAI/ML | Apache Airflow | CRM Integration | Cloud Data | Cloud Data PlatformsSenior-level Full TimeNY, United States18h ago
-
Senior Staff Data Engineer USD 123K-185KAPI | Automated testing | Cloud platform | Data Analysis | Data GovernanceDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US19h ago
-
Senior Power BI Developer (Remote) CAD 110K-130KCI/CD | DAX | DAX Studio | Dimensional Modeling | Direct LakeContinuous training | Paid health benefits | RRSP match | Remote work | Stable year round employmentSenior-level Full TimeBC, CA R23h ago
-
Senior-level Full TimeOklahoma City23h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R23h ago
-
Associate AI - Data Scientist / ML Engineer (Azure) USD 46K-110KAzure Container | Azure Container Instances | Azure Data | Azure Data Factory | Azure Data LakeDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeNashville, TN, US1d ago
-
Agile Development | CI/CD | Data Pipelines | Docker | GitHubAbility to obtain TS SCI with CI Polygraph | Active TS clearanceSenior-level Full TimeHuntsville, AL1d ago
-
Staff Machine Learning Engineer USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability coverage | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA1d ago
-
Staff Machine Learning Engineer USD 152K-261KAWS | Airflow | Apache Spark | BigQuery | Cloud platform401k plan with company match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeMountain View, USA1d ago