Principal Applied Scientist - CTO Office
Overview The Microsoft Security office of the CTO is expanding to drive the development of a new type of GenAI foundation architecture that can effectively address the unique challenges of cybersecurity: cybersecurity can benefit from holistic processing of the huge “haystacks” of security data, in order to better find and correlate the few “needles” of malicious behaviors; however, current LLM technology cannot handle such vast amounts of data concurrently. This new joint initiative aims to develop a new neural-network architecture that can overcome this limitation. This is a unique opportunity to engage in frontier research that is also product-focused. You’ll join a small, multidisciplinary and technically deep team in the Microsoft Security Office of the CTO, built to take on important problems whose answers are not yet known. We bring together applied AI, research, architecture, engineering and product thinking in empowered teams with clear objectives, short learning cycles and substantial autonomy. Our job is not simply to deliver against an established roadmap: we explore emerging opportunities, build and experiment, generate evidence, validate new technologies with customers, and establish the technical direction that enables product organisations to scale what works. It’s an environment for scientists who want the freedom to pursue genuinely hard technical questions while staying relentlessly connected to real customer and product impact. As a Principal Applied Scientist, you will own end‑to‑end model development for security scenarios, including developing new model architectures, continual pre‑training, task‑focused fine‑tuning, reinforcement learning, and objective, benchmark‑driven evaluation to ensure models are optimized, validated, and production ready. You will also drive training efficiency and reliability on distributed GPU systems, deepen model abilities (reasoning, tool‑use, prediction horizon, etc), and embed Responsible AI, privacy, and compliance. The role is hands‑on and impact‑focused, partnering closely with engineering and product to translate innovations into shipped, measurable outcomes, defining quality gates and readiness criteria, and mentoring scientists and engineers to scale results across globally distributed teams. Responsibilities Technical Leadership & Ownership : set technical direction for major security domain initiatives; lead security model programs spanning pre‑training, task tuning, reinforcement learning, and evaluation; translate cutting‑edge research into production‑ready capabilities. Advanced Model Design – Building and customizing deep learning model architectures (e.g., modifying transformer blocks, attention/memory modules, etc.) at the SLM/LLM scale; making principled architectural tradeoffs to improve reliability, robustness, and security‑specific behavior. Advanced Model Training – Apply deep expertise in pre-training, post-training, and reinforcement learning (RL) for both language and other modalities, including time-series. Design & Evaluate Datasets – Build high-quality datasets and benchmarks; define objective evaluation frameworks and quality gates; run ablation studies to measure impact and optimize data and training effectiveness to support confident product decisions. Develop Data Infrastructure – Create and maintain scalable pipelines for ingestion, preprocessing, filtering, and annotation of large, complex datasets, with attention to privacy, governance, and long‑term reuse across security scenarios and continual learning loops that improve deployed agents over time. Research & Innovation – Collaborate with cross-functional teams to push research and product boundaries, delivering models that make a real-world impact. Qualifications M.Sc. / Ph.D. in Computer Science, Information Systems, Electrical or Computer Engineering or Data Science (Ph.D. strongly preferred). Candidates with M.Sc. / Ph.D. in related fields with proven industry experience or a strong publication record in the areas of LLM, Information Retrieval, Machine Learning, Natural Language Processing, Time Series Forecasting and Deep Learning are considered as well. Proven hands-on experience of at least 5 years (including post-grad work) in building and deploying Machine Learning products. Key areas of expertise include Natural Language Processing and Large Language Models, along with an understanding of concepts such as Privacy and Responsible AI. Candidates are expected to demonstrate a strong history of successfully translating applied research into production-ready solutions, along with a proven track record of delivering projects within large-scale production environments. Proven expertise in the LLM and/or time-series forecasting domain, demonstrating comprehensive knowledge of relevant concepts in the domain. Ideal applicants should be proficient in areas such as LLM’s pre and post training, including CPT, SFT and RL, LLM benchmarking, agentic flows, and mod
More jobs at Microsoft
- Security Researcher II /Senior Security Researcher - Microsoft Defender (Multiple Roles)
- Senior Applied Science - Microsoft Security
- Principal Security Research
- Cloud Solution Architect - Security
- Customer Success Account Manager
- Software Engineer II - Cryptography & Post-Quantum Security (Multiple Roles)
Find your next role on Israel's job board.
Browse all jobs