LLM Pre-training & Distributed Engineer (AI Infrastructure)
Tasks
- Automate checkpointing and failure recovery
- Optimize networking and memory management
- Orchestrate distributed training runs
Perks/Benefits
- N/A
Skills/Tech-stack
3D Parallelism | C++ | CUDA | DeepSpeed | Infiniband | Kubernetes | Megatron-LM | PyTorch | Python | RDMA | Slurm
Education
N/A
Related jobs
-
Senior AI Engineer AUD 142K-163KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy in role | Learning and development programs | Mentorship cultureSenior-level Full TimeMelbourne, Australia R8h ago
-
Data Engineer - Coles 360 - Melbourne AUD 110K-140KAzure | BigQuery | CI/CD | DBT | Data ModelingDiscounts on supermarket and liquor | Fitness classes | Free parking | Gym facility | Hybrid working optionsMid-level Full TimeHawthorn East Melbourne, VIC, AU, 312313h ago
-
Senior-level Full TimePerth, Australia16h ago
-
Associate AI Engineer AUD 100K-120K.NET | Azure | Azure Container | Azure Container Apps | Container AppsAnnual leave | Collaborative team culture | Flexible working environment | Parental leave | Professional developmentMid-level Full TimeMelbourne, VIC, Australia1d ago
-
Senior Data Engineer AUD 129K-142KBitbucket | DB2 | Data Quality | Data quality assurance | MySQLAnnual flu vaccinations | Discounted health and fitness memberships | Employee assistance program | Flexible working arrangements | Generous leave entitlementsSenior-level Full TimeSydney, NSW, AU, 20001d ago
-
AI Engineer | ML, GenAI, LLM, Python, Azure | Sydney AUD 100K-124KAI Safety | AWS | Anomaly Detection | Azure | ClusteringFlexible work arrangements | Flexible working options | Market-leading parental leave | Paid volunteering days | Retail discountsMid-level Full TimeSydney, NSW, AU1d ago
-
Data Engineer - Asset Management Consultant AUD 70K-80KAgile | Amazon Web Services | Apache Spark | Azure | Cloud platformEntry-level Full TimeBrisbane, Australia1d ago
-
Senior Software Engineer - MLOps AUD 130K-150KAWS | Amazon SageMaker | Aurora DB | Batch inference | CI/CDFlexible work arrangements | Job shareSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …1d ago
-
Data Engineer - Asset Management Consultant AUD 70K-80KAmazon Web Services | Apache Spark | Azure | Containerization | Data CleansingEntry-level Full TimeBrisbane, Australia1d ago
-
Advanced Analytics Specialist AUD 100K-120KC++ | CPLEX | Cloud Computing | Data Visualization | DatabricksCheaper retail and technology services | Discounted flights | Discounts on accommodation | Discounts on car hire | Discounts on experiencesMid-level Full TimeBrisbane1d ago
-
API | Automation | Data Architecture | Data Modeling | IndexingCollaborative engineering culture | End-to-end ownership | Exposure to modern APIs automation and AI | Flexible work location | Fully remoteSenior-level Full TimeAustralia R2d ago
-
Actor-critic | Deep learning | Experimentation | Exploration/exploitation | Language ProcessingCareer growth opportunities | Flexible work culture | Fully remote | Global collaboration opportunitiesMid-level Full TimeAustralia R3d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Collaborative team | Opportunities for impact | Remote-friendlyMid-level Full TimeMelbourne, Australia3d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | JavaScript100 percent remote work | Career growth opportunities | Flexible work environment | International team collaborationMid-level Full TimeAustralia R3d ago
-
AI Solution Designer – Data & AI AUD 60K-140KAI Foundry | AI Search | API Integration | AWS Bedrock | AWS LambdaFlexible hours | Health and wellbeing initiatives | Learning and growth opportunities | Paid parental leaveSenior-level Full TimeSydney, NSW, Australia3d ago
-
Data Engineer AUD 117K-132KAzure | CI/CD | DBT | Data Governance | Data LineageAffordable parking | Discounted study opportunities | Flexible working | Health and wellbeing programs | Hybrid workingSenior-level Full TimeHerston Campus, Australia3d ago
-
Data Engineer AUD 117K-132KCI/CD | DBT | Data Lineage | Data handling | DatabricksAffordable parking | Discounted study opportunities | Flexible working | Health and wellbeing programs | Hybrid workingSenior-level Full TimeHerston Campus, Australia3d ago
-
Senior-level Full TimeMelbourne Support Centre4d ago
-
Accelerate | Data Analysis | Deep learning | Diffusers | Distributed SystemsCareer growth opportunities | Continuous learning | Flexible, distributed work environment | Fully remote work | Global collaboration opportunitiesMid-level Full TimeAustralia R4d ago
-
Data Curation | Deep learning | Distributed Training | GPU Computing | JAXAutonomous work culture | Flexible work location | Fully remote work | High-performance GPU clusters | Professional growth opportunitiesSenior-level Full TimeAustralia R4d ago
-
Automation and AI Engineer AUD 110K-130KAPI Integration | Copilot Studio | Databricks | Dynamics 365 | Enterprise IntegrationAdditional birthday day | Coaching and counselling services | Corporate Bupa health insurance rates | Employer super access | Hybrid working modelMid-level Full TimeSydney, NSW, Australia4d ago
-
API Development | Amazon Web Services | ArgoCD | Arize AI | Batch inferenceAdditional annual YOU days | Annual flu vaccinations | Cycling showers access | Hybrid flexibility | In-office lunchSenior-level Full TimeBarangaroo, NSW, Australia4d ago
-
Principal AI Engineer AUD 130K-180KAWS Bedrock | Community Detection | Confidence scoring | Data Ingestion | Data ModelingSenior-level Full TimeMelbourne4d ago
-
Staff Data Engineer (AWS Cloud and AI) AUD 129K-142KAPI Gateway | AWS DataZone | AWS Glue | AWS Lake Formation | AWS LambdaFlexible start and finish times | Flexible working options | Hybrid work | Job share | Part-time arrangementsSenior-level Full TimeSydney, NSW - CBP South, 11 …4d ago
-
Lead Consultant - PowerBI & Databricks AUD 118K-140KAWS | Agile | Apache Spark | Azure | Data IngestionBaseline Security Clearance support | Career development paths | Flexible work | Reward and recognition programs | Volunteering leaveSenior-level Full TimeCanberra, Australian Capital Territory, Australia5d ago