Software Applications Engineer (GPU Machine Learning End-to-End Performance)
Advanced Micro Devices Voir toutes les offres
- Markham, ON
- Permanent
- Temps-plein
- Work within a team on Machine Learning SW and Workload development in pre and post-silicon phases of product development enabling next-generation of ML workloads in functional and performance attainment.
- Develop tools that analyze ML model graphs and automatically suggest or perform optimizations (layout changes, fusion, quantization, packing strategies).
- Build AI-assisted visualization tools to identify bottlenecks, inefficient memory patterns, operator hotspots, or scheduler issues.
- Integrate AI agents to automate tasks such as code generation, performance diagnosis, or graph rewriting.
- Contribute to internal tools that visualize GPU memory use, async compute overlap, and tensor residency.
- Build ML kernels, microbenchmarks, operators, optimizing for topics such as tile sizes, block configs, memory layouts to achieve optimized performance.
- Collaborate across kernel, runtime, and model teams; participate in code reviews and design discussions.
- Collaborate with inter-disciplinary teams to improve system-level efficiency, end-to-end performance, and power.
- Experience with at least one of the following:
- Model transformation tools (ONNX, TensorRT, OpenVINO etc).
- Kernel technologies (CUDA, HIP, Vulkan compute).
- Strong programming skills in Python and/or C++.
- Experience building tools or pipelines using AI agents, LLMs, or automation frameworks.
- Understanding of machine learning architectures, for example transformer basics (attention, tensor shapes, KV caching, memory patterns).
- Ability to interpret profiling output (ROCm tools, PyTorch profiler, Nsight, Perfetto).
- Comfortable working in exploratory environments and iterating on tool ideas quickly.
- Track record in using AI tooling to accelerate engineering work.
- Strong collaboration and communication skills.
- Master / Bachelor of Computer Systems, Computer Science, Software Engineering, or similar degree.