RL Blog

Spectra Assure Free Trial

Get your 14-day free trial of Spectra Assure for Software Supply Chain Security

Get Free TrialMore about Spectra Assure Free Trial
Blog
Events
About Us
Webinars
In the News
Careers
Demo Videos
Cybersecurity Glossary
Contact Us
reversinglabsReversingLabs: Home
Privacy PolicyCookiesImpressum
All rights reserved ReversingLabs © 2026
XX / TwitterLinkedInLinkedInFacebookFacebookInstagramInstagramYouTubeYouTubeblueskyBlueskyRSSRSS
Back to Top
The inaugural Gartner® Magic Quadrant™ for Software Supply Chain Security is outGET THE REPORT
Skip to main content
Contact UsSupportBlogCommunity
reversinglabs
ReversingLabs: Home
Solutions
Secure Software OnboardingSecure Build & ReleaseVerify AI Supply ChainIntegrate Safe Open SourceGo Beyond the SBOM
Increase Email Threat ResilienceDetect Malware in File Shares & StorageAdvanced Malware Analysis SuiteICAP Enabled Solutions
Scalable File AnalysisHigh-Fidelity Threat IntelligenceCurated Ransomware FeedAutomate Malware Analysis Workflows
Products & Technology
Spectra Assure®Software Supply Chain SecuritySpectra DetectHigh-Speed, High-Volume, Large File AnalysisSpectra AnalyzeIn-Depth Malware Analysis & Hunting for the SOCSpectra IntelligenceAuthoritative Reputation Data & Intelligence
Spectra CoreIntegrations
Industry
Energy & UtilitiesFinanceHealthcareHigh TechPublic Sector
Partners
Become a PartnerValue-Added PartnersTechnology PartnersMarketplacesOEM Partners
Alliances
Resources
BlogContent LibraryCybersecurity GlossaryConversingLabs PodcastEvents & WebinarsLearning with ReversingLabsWeekly Insights Newsletter
Customer StoriesDemo VideosDocumentationOpenSource YARA Rules
Company
About UsLeadershipCareersSeries B Investment
Events
Press ReleasesIn the News
Pricing
Software Supply Chain SecurityMalware Analysis and Threat Hunting
Request a demo
Menu
Dev & DevSecOpsMarch 29, 2023

Do you trust AI to find app sec holes while you sleep?

Purr-fect? Or cat-astrophe? Microsoft wants you to cat nap as its Security Copilot combats software security threats.

Richi Jennings, Independent industry analyst, editor, and content strategist.Richi Jennings
FacebookFacebookXX / TwitterLinkedIn
LinkedIn
blueskyBluesky
Email Us

Main Story

IntroPurr-fect? Or cat-astrophe?And Finally:

Microsoft has turned OpenAI’s LLM onto cybersecurity. “Security Copilot” is its name for conversational, ChatGPT security analysis and monitoring.

It’ll answer questions and learn about your network, summarizing and interpreting as it goes. It can also help organizations stick to privacy regulations — GDPR, CCPA and the like.

Or, at least, so says Microsoft. In this week’s Secure Software Blogwatch, we wonder whether to believe the hype.

Your humble blogwatcher curated these bloggy bits for your entertainment. Not to mention: GAI in GPT-10?

Purr-fect? Or cat-astrophe?

What’s the craic? Chris Paoli reports — “AI-Powered Microsoft Security Copilot Revealed”:

“Can perform a number of actions”

Microsoft on Tuesday announced a new predictive language chat tool for security experts. … Security Copilot … aims to provide security experts with increased visibility and network analysis with the help of a ChatGTP-4-powered assistant.

…

Microsoft said that the new AI-based security offering, which is now currently in preview, will not replace security experts, but improve IT's efficiency in handling threats. [It] is powered by data collected from other security products, including Microsoft Defender, Intune and Sentinel, and brings together the company's real-time analysis of global threats.

…

Once [an] incident is detected, [it] can perform a number of actions, including isolating the affected devices from the network and blocking the harmful traffic. [And it] can assist with data discovery, classification, and protection, as well as provide reports and audits to demonstrate compliance with regulations such as … GDPR.

What’s the UX like? Sergiu Gatlan goes deeper — “Microsoft brings GPT-4-powered Security Copilot to incident response”:

“Answers defenders’ security-related questions”

Security Copilot [is] a new ChatGPT-like assistant, powered by artificial intelligence, that takes advantage of Microsoft's threat intelligence footprint to make faster decisions during incident response and to help with threat hunting and security reporting. … It is powered by OpenAI's GPT-4 advanced large language model (LLM) combined with what Microsoft describes as a "security-specific model."

…

Security Copilot answers defenders' security-related questions via a ChatGPT-like interface and continuously learns from these interactions to adapt to each enterprise environment to advise them on the best course of action. … Its primary goal is to enhance security analysts' capabilities by expediting threat intelligence summarizing and interpreting, enabling them to spot malicious activity a lot faster while analyzing web traffic.

Horse’s mouth? Here’s Vasu Jakkal (and her legions of PR flacks) — “Introducing Microsoft Security Copilot”:

Microsoft Security Copilot is the first security product to enable defenders to move at the speed and scale of AI. [It] incorporates a growing set of security-specific skills and is informed by Microsoft’s unique global threat intelligence and more than 65 trillion daily signals. Security Copilot also delivers an enterprise-grade security and privacy-compliant experience as it runs on Microsoft Azure’s Hyperscale infrastructure.

Sounds interesting, right? Karen Ndlovu, for one, welcomes her new generative, LLM overlords:

Congratulations … on the launch of a game changing security product! Can’t wait to see it in action across the various security use-cases.

But others are skeptical. One of many is noisycarlos:

I find Copilot really useful sometimes. But I'd be a bit iffy about using it for security stuff. Sometimes it makes mistakes that are easy to miss because they look correct, but a tiny thing is off.

For example, it will suggest to write 'function(example, test)' but the function is supposed to be written function(test, example). The code will run and all, but the results will be incorrect and it takes a while to find the issue.

In my web app: Annoying. … In security: Might cost more than a little frustration.

And Chris Smith thinks it “might be the best use of ChatGPT yet”:

Microsoft says that Security Copilot should respond to security incidents within minutes instead of hours or days. That way, you might not have to wait months to learn how and why your LastPass account was hacked. [It] could also catch hidden malicious behavior that humans might miss. And it can even reverse-engineer exploits it detects.

…

Microsoft also warns that Security Copilot might sometimes deliver inaccurate information as it assesses threats. But IT department members will be able to report errors as they catch them. As a reminder, ChatGPT can make mistakes, so any product incorporating the language model would be prone to some factual issues.

I’m sorry? Factual issues? Chris Matyszczyk is mistrustful — “This really was an excellent way to put it”:

“Utter hokum”

I've just caught up with Microsoft and its latest poetic use of words. Or, depending on your view, its twisting of the English language to serve a tortured ideal.

…

Hark the words of Microsoft VP … Jared Spataro: "Sometimes, Copilot will get it right. Other times, it will be usefully wrong, giving you an idea that's not perfect, but still gives you a head start." I wonder how long it took for someone to land on the concept of "usefully wrong." You wouldn't want, say, the steering wheel on your car to be usefully wrong. Any more than you'd want your electrician to be usefully wrong.

…

The whole tech industry is seemingly built upon the hubris that whatever it does makes the world a better place. Even if … it may do the opposite. Everything from full self-driving to Facebook has been lauded as the next, greatest coming of an unfathomably glorious, correct future — until, that is, it's revealed [as] utter hokum.

…

[And] didn't Microsoft just lay off its entire AI ethics and society team?

Not sure how “useful” that would be. Neither is quantaman:

The best way to think of these chat engines is as a coworker who is brilliant, extremely knowledgeable, who doesn't really listen to you, and who is prone to make things up when they're uncertain. … I'm definitely worried about its tendency to fib. It's not just that it's wrong, it's that it's both confident and somewhat convincing in its wrongness.

Ouch. Is that entirely fair? Nicholas le Compte freewheels down into the hype cycle’s trough of disillusionment:

There’s a place where AI can provide a cybersecurity “checklist” or act like an editor to point out dumb security bugs. But I am sick to death of these AI “news” stories which pretend future corporate aspirations are current engineering milestones.

Journalists need to be far more skeptical of for-profit AI, but with this story and yesterday’s atrocious article about AI job interviews, it really seems like tech journalism has learned nothing from the self-driving car craze in 2015.

In related news, Dina Bass harmonizes — “Google Partners with AI Startup Replit”:

[In] a bid to compete with a similar product from Microsoft Corp.’s GitHub and OpenAI, Replit’s Ghostwriter, which has 20 million users, will rely on Google’s language-generation AI to improve its ability to suggest blocks of code, complete programs and answer developer questions. [AWS] also sells a product in this category called CodeWhisperer.

…

[This] is the latest volley in a series of competing AI product releases and improvements from Google, Microsoft and Microsoft-backed OpenAI since the startup gained public attention last year with the wider release of its ChatGPT chatbot. Replit wants to improve on GitHub’s Copilot by providing a greater understanding of all the different pieces of software a developer uses to write code.

Meanwhile, devin3782’ll be back:

I'm sure this how Skynet started.

And Finally:

OpenAI CEO: The road to artificial general intelligence

Previously in And finally


You have been reading Secure Software Blogwatch by Richi Jennings. Richi curates the best bloggy bits, finest forums, and weirdest websites … so you don’t have to. Hate mail may be directed to @RiCHi or ssbw@richi.uk. Ask your doctor before reading. Your mileage may vary. Past performance is no guarantee of future results. Do not stare into laser with remaining eye. E&OE. 30.

Image sauce: Kate Stone Matheson (via Unsplash; leveled and cropped)

Tags:Dev & DevSecOps

More Blog Posts

Main Story

IntroPurr-fect? Or cat-astrophe?And Finally:

Follow us

XX / TwitterLinkedInLinkedInFacebookFacebookInstagram
Richi Jennings
cat snuggled under covers in bed

Join the free Spectra Assure Community today to get hands-on with RL's binary analysis-based software supply chain security platform.

Keep learning

  • Get up to speed on the agentic SOC in this webinar: Autonomy, Not Autopilot: Talking Agentic SOC. Plus: Learn about the new Agentic SOC Alliance.
  • Learn how Gartner® named RL a supply chain security 'visionary.' Download: Gartner® Magic Quadrant™ for Software Supply Chain Security.
  • Update you understanding of the Agentic Development Security tools landscape in this webinar with Forrester Sr. Analyst Janet Worthington.
  • Take a deep dive on the state of software security with RL's Software Supply Chain Security Report 2026. Plus: See the the webinar discussing the findings.

Explore RL's Spectra suite: Spectra Assure for software supply chain security, Spectra Detect for scalable file analysis, Spectra Analyze for malware analysis and threat hunting, and

Instagram
YouTubeYouTube
blueskyBluesky
Spectra Intelligence
for reputation data and intelligence.

Subscribe

Get the best of RL Blog delivered to your in-box weekly. Stay up to date on key trends, analysis and best practices across threat intelligence and software supply chain security.

Topics

All Blog PostsAppSec & Supply Chain SecurityDev & DevSecOpsProducts & TechnologySecurity OperationsThreat Research

Related

Can Lean improve security for AI-coded software?Security teams ditch AI-only pen testing‘Download pumping’ joins the trust-abuse bandwagon

Can Lean improve security for AI-coded software?

AI coding requires the stack be reconstructed with mathematical proofs built in — a task well suited to the Lean language. Here’s the reality.

Learn More about Can Lean improve security for AI-coded software?
Can Lean improve security for AI-coded software?

Security teams ditch AI-only pen testing

A new report finds weakening trust in AI-only testing — and more willingness to keep humans in the loop. Here's why.

Learn More about Security teams ditch AI-only pen testing
Security teams ditch AI-only pen testing

‘Download pumping’ joins the trust-abuse bandwagon

While this repository vector is not new, researchers have uncovered a new twist for exploiting trusted metrics to hide malicious code.

Learn More about ‘Download pumping’ joins the trust-abuse bandwagon
‘Download pumping’ joins the trust-abuse bandwagon
Lean Language
Human in the loop
Trust abuse