Opinion: Controlled Feature Rollout and A/B Testing Defeat The Purpose Of The Entire Program


T

TechnoFlash7560

Well-known member
Member
Local time
2:01 PM
Posts
40
OS
Windows 11 v25H2 / Windows vNext Enterprise
Remember, in the early days, a decade ago, when being a Windows Insider in the Fast Ring meant you would always get new features to test and provide feedback on?
More importantly, every new feature that was announced in a build's release notes would be there immediately, available and enabled, by default.
No need to use a 3rd party tool to force enable a feature.

Fast forward to 2025, being a Windows Insider in the Dev Channel no longer means you'll be able to test any of the announced features, you may get the feature(s) or you may not (most likely not).

Mind you, the Dev Channel is according to Microsoft, the place to be if you want to test new features early.

It bums me out and honestly irritates me a bit when I read a Dev Channel build's release notes, there's a cool new feature (such as the redesigned start menu), but its "gradually rolling out..."



What is the point of having an Insider Program if all Insiders can't test the features and therefore are unable to provide feedback on them?

It kind of defeats the purpose of the whole thing IMHO.

Not to mention the Canary Channel... which gets new features, but several weeks or months after Dev and Beta.


This post is just an opinion of mine.
 
Windows Build/Version
25H2

My Computer

System One

  • OS
    Windows 11 v25H2 / Windows vNext Enterprise
    Computer type
    PC/Desktop
    Manufacturer/Model
    Custom Built Tower
    CPU
    Intel Core i5-11400
    Motherboard
    MSI B560M-A PRO
    Memory
    32GB DDR4 3200MHz
    Graphics Card(s)
    AMD Radeon RX 5500 XT 8GB GDDR6 / Intel UHD Graphics 730
    Sound Card
    Onboard Realtek ALC897
    Monitor(s) Displays
    LG 22MP58VQ-P 21.5" IPS LED
    Screen Resolution
    1920x1080
    Hard Drives
    1x 500GB Kingston Fury Renegade PCIe Gen4x4 NVMe SSD
    PSU
    Corsair CS850M 850W 80 Plus Gold
    Case
    Sharkoon M25-W Mid-Tower Case
    Cooling
    2x 240mm fans on the front, 1x 240mm fan on the back
    Keyboard
    Skiller Mechanical RGB Keyboard
    Mouse
    HP RGB Optical Mouse
    Internet Speed
    500Mbps Fiber
    Browser
    Microsoft Edge
    Antivirus
    Microsoft Defender
TechnoFlash7560 said:
Remember, in the early days, a decade ago, when being a Windows Insider in the Fast Ring meant you would always get new features to test and provide feedback on?
More importantly, every new feature that was announced in a build's release notes would be there immediately, available and enabled, by default.
No need to use a 3rd party tool to force enable a feature.

Fast forward to 2025, being a Windows Insider in the Dev Channel no longer means you'll be able to test any of the announced features, you may get the feature(s) or you may not (most likely not).

Mind you, the Dev Channel is according to Microsoft, the place to be if you want to test new features early.

It bums me out and honestly irritates me a bit when I read a Dev Channel build's release notes, there's a cool new feature (such as the redesigned start menu), but its "gradually rolling out..."



What is the point of having an Insider Program if all Insiders can't test the features and therefore are unable to provide feedback on them?

It kind of defeats the purpose of the whole thing IMHO.

Not to mention the Canary Channel... which gets new features, but several weeks or months after Dev and Beta.


This post is just an opinion of mine.
Click to expand...
Yep - been a major complaint of mine many times on this forum. It is pure BS by MS.

I reckon it is so the "little darlings" in MS avoid getting lots of negative feedback which would make them go home in tears to mumny.
 

My Computer

System One

  • OS
    Windows 11 Pro + Win11 Canary VM.
    Computer type
    Laptop
    Manufacturer/Model
    ASUS Zenbook 14
    CPU
    I9 13th gen i9-13900H 2.60 GHZ
    Motherboard
    Yep, Laptop has one.
    Memory
    16 GB soldered
    Graphics Card(s)
    Integrated Intel Iris XE
    Sound Card
    Realtek built in
    Monitor(s) Displays
    laptop OLED screen
    Screen Resolution
    2880x1800 touchscreen
    Hard Drives
    1 TB NVME SSD (only weakness is only one slot)
    PSU
    Internal + 65W thunderbolt USB4 charger
    Case
    Yep, got one
    Cooling
    Stella Artois (UK pint cans - 568 ml) - extra cost.
    Keyboard
    Built in UK keybd
    Mouse
    Bluetooth , wireless dongled, wired
    Internet Speed
    900 mbs (ethernet), wifi 6 typical 350-450 mb/s both up and down
    Browser
    Edge
    Antivirus
    Defender
    Other Info
    TPM 2.0, 2xUSB4 thunderbolt, 1xUsb3 (usb a), 1xUsb-c, hdmi out, 3.5 mm audio out/in combo, ASUS backlit trackpad (inc. switchable number pad)

    Macrium Reflect Home V8
    Office 365 Family (6 users each 1TB onedrive space)
    Hyper-V (a vm runs almost as fast as my older laptop)
Ask CrowdStrike why a company would do gradual rollouts.
 

My Computer

System One

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    Intel NUC12WSHi7
    CPU
    12th Gen Core i7-1260P
    Motherboard
    NUC12WSBi7
    Memory
    64 GB Micron PC4-25600
    Graphics Card(s)
    Intel Iris Xe Graphics
    Sound Card
    on-board Realtek HD Audio
    Monitor(s) Displays
    Dell U3219Q
    Screen Resolution
    3840 x 2160
    Hard Drives
    Samsung SSD 990 PRO 1TB
    Crucial MX500 2 TB
    Antivirus
    Microsoft Defender
Probably... cause Windows Insider user base got really big (to big). To many users joined - so the devs can't keep up with the humongous flow of reports - for newly backed features braking Windows - on a specific system, even tho - they're intended purely for alpha testing (might take another year till release). So, there's minimum priority to fix them. While bugs of relevant core features - which are bound to be available in upcoming updates - have an actual urgency.

But hey, if you still want to force test - said alpha testing feature - there's this tool that could help with that:

github.com

GitHub - thebookisclosed/ViVe: C# library and console app for using new feature control APIs available in Windows 10 version 2004 and newer

C# library and console app for using new feature control APIs available in Windows 10 version 2004 and newer - thebookisclosed/ViVe
github.com github.com

...since sometimes this bleeding edge features - are already available in latest Windows insider release - but simply disabled.
 

My Computer

System One

  • OS
    WinDOS 25H2
    Computer type
    Laptop
    CPU
    Intel & AMD
    Memory
    SO-DIMM SK Hynix 15.8 GB Dual-Channel DDR4-2666 (2 x 8 GB) 1329MHz (19-19-19-43)
    Graphics Card(s)
    nVidia RTX 2060 6GB Mobile GPU (TU106M)
    Sound Card
    Onbord Realtek ALC1220
    Screen Resolution
    1920 x 1080
    Hard Drives
    1x Samsung PM981 NVMe PCIe M.2 512GB / 1x Seagate Expansion ST1000LM035 1TB
neves said:
Probably... cause Windows Insider user base got really big (to big). To many users joined - so the devs can't keep up with the humongous flow of reports - for newly backed features braking Windows - on a specific system, even tho - they're intended purely for alpha testing (might take another year till release). So, there's minimum priority to fix them. While bugs of relevant core features - which are bound to be available in upcoming updates - have an actual urgency.

But hey, if you still want to force test - said alpha testing feature - there's this tool that could help with that:

github.com

GitHub - thebookisclosed/ViVe: C# library and console app for using new feature control APIs available in Windows 10 version 2004 and newer

C# library and console app for using new feature control APIs available in Windows 10 version 2004 and newer - thebookisclosed/ViVe
github.com github.com

...since sometimes this bleeding edge features - are already available in latest Windows insider release - but simply disabled.
Click to expand...
I bet MS could pre-screen the feedback and sort into common themes? If copilot (or other AIs) is half as good as claimed pre-screening lots of replies should be a doddle.
 

My Computer

System One

  • OS
    Windows 11 Pro + Win11 Canary VM.
    Computer type
    Laptop
    Manufacturer/Model
    ASUS Zenbook 14
    CPU
    I9 13th gen i9-13900H 2.60 GHZ
    Motherboard
    Yep, Laptop has one.
    Memory
    16 GB soldered
    Graphics Card(s)
    Integrated Intel Iris XE
    Sound Card
    Realtek built in
    Monitor(s) Displays
    laptop OLED screen
    Screen Resolution
    2880x1800 touchscreen
    Hard Drives
    1 TB NVME SSD (only weakness is only one slot)
    PSU
    Internal + 65W thunderbolt USB4 charger
    Case
    Yep, got one
    Cooling
    Stella Artois (UK pint cans - 568 ml) - extra cost.
    Keyboard
    Built in UK keybd
    Mouse
    Bluetooth , wireless dongled, wired
    Internet Speed
    900 mbs (ethernet), wifi 6 typical 350-450 mb/s both up and down
    Browser
    Edge
    Antivirus
    Defender
    Other Info
    TPM 2.0, 2xUSB4 thunderbolt, 1xUsb3 (usb a), 1xUsb-c, hdmi out, 3.5 mm audio out/in combo, ASUS backlit trackpad (inc. switchable number pad)

    Macrium Reflect Home V8
    Office 365 Family (6 users each 1TB onedrive space)
    Hyper-V (a vm runs almost as fast as my older laptop)
pseymour said:
Ask CrowdStrike why a company would do gradual rollouts.
Click to expand...
Was that where the update(s) got released by a third party before the update(s) were ready to be released?
 

My Computers

System One System Two

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    PowerSpec B746
    CPU
    Intel Core i7-10700K
    Motherboard
    ASRock Z490 Phantom Gaming 4/ax
    Memory
    16GB (8GB PC4-19200 DDR4 SDRAM x2)
    Graphics Card(s)
    NVIDIA GeForce GTX 1050 TI
    Sound Card
    Realtek Audio
    Monitor(s) Displays
    #1. LG ULTRAWIDE 34" #2. AOC Q32G2WG3 32"
    Screen Resolution
    #1. 3440 X 1440 #2. 1920 x 1080
    Hard Drives
    NVMe WDC WDS100T2B0C-00PXH0 1TB
    Samsung SSD 860 EVO 1TB
    PSU
    750 Watts (62.5A)
    Case
    PowerSpec/Lian Li ATX 205
    Keyboard
    Logitech K270
    Mouse
    Logitech M185
    Browser
    Microsoft Edge and Firefox
    Antivirus
    Webroot SecureAnywhere CE 26.1
  • Operating System
    Windows 11 Canary Channel
    Computer type
    PC/Desktop
    Manufacturer/Model
    PowerSpec G156
    CPU
    Intel Core i5-8400 CPU @ 2.80GHz
    Motherboard
    AsusTeK Prime B360M-A
    Memory
    16 MB DDR 4-2666
    Monitor(s) Displays
    23" Speptre HDMI 75Hz
    Screen Resolution
    1920x1080
    Hard Drives
    Samsung 970 EVO 500GB NVMe
    Keyboard
    Logitek K270
    Mouse
    Logitek M185
    Browser
    Firefox, Edge and Edge Canary
    Antivirus
    Windows Defender

My Computer

System One

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    Intel NUC12WSHi7
    CPU
    12th Gen Core i7-1260P
    Motherboard
    NUC12WSBi7
    Memory
    64 GB Micron PC4-25600
    Graphics Card(s)
    Intel Iris Xe Graphics
    Sound Card
    on-board Realtek HD Audio
    Monitor(s) Displays
    Dell U3219Q
    Screen Resolution
    3840 x 2160
    Hard Drives
    Samsung SSD 990 PRO 1TB
    Crucial MX500 2 TB
    Antivirus
    Microsoft Defender
pseymour said:
This thing... 2024 CrowdStrike-related IT outages - Wikipedia
Click to expand...
Thanks. Now I remember reading about that. I'm not sure how that relates to MS doing the A/B testing in the Insider builds though. MS has warned us that any new build release could cause us problems that may need a rollback or clean install to fix. Not only that but when we joined the Insider channel we agreed to take the risk.
 

My Computers

System One System Two

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    PowerSpec B746
    CPU
    Intel Core i7-10700K
    Motherboard
    ASRock Z490 Phantom Gaming 4/ax
    Memory
    16GB (8GB PC4-19200 DDR4 SDRAM x2)
    Graphics Card(s)
    NVIDIA GeForce GTX 1050 TI
    Sound Card
    Realtek Audio
    Monitor(s) Displays
    #1. LG ULTRAWIDE 34" #2. AOC Q32G2WG3 32"
    Screen Resolution
    #1. 3440 X 1440 #2. 1920 x 1080
    Hard Drives
    NVMe WDC WDS100T2B0C-00PXH0 1TB
    Samsung SSD 860 EVO 1TB
    PSU
    750 Watts (62.5A)
    Case
    PowerSpec/Lian Li ATX 205
    Keyboard
    Logitech K270
    Mouse
    Logitech M185
    Browser
    Microsoft Edge and Firefox
    Antivirus
    Webroot SecureAnywhere CE 26.1
  • Operating System
    Windows 11 Canary Channel
    Computer type
    PC/Desktop
    Manufacturer/Model
    PowerSpec G156
    CPU
    Intel Core i5-8400 CPU @ 2.80GHz
    Motherboard
    AsusTeK Prime B360M-A
    Memory
    16 MB DDR 4-2666
    Monitor(s) Displays
    23" Speptre HDMI 75Hz
    Screen Resolution
    1920x1080
    Hard Drives
    Samsung 970 EVO 500GB NVMe
    Keyboard
    Logitek K270
    Mouse
    Logitek M185
    Browser
    Firefox, Edge and Edge Canary
    Antivirus
    Windows Defender
The company or the update type isn't really relevant. You roll out new features en masse, you get problems en masse.
 

My Computer

System One

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    Intel NUC12WSHi7
    CPU
    12th Gen Core i7-1260P
    Motherboard
    NUC12WSBi7
    Memory
    64 GB Micron PC4-25600
    Graphics Card(s)
    Intel Iris Xe Graphics
    Sound Card
    on-board Realtek HD Audio
    Monitor(s) Displays
    Dell U3219Q
    Screen Resolution
    3840 x 2160
    Hard Drives
    Samsung SSD 990 PRO 1TB
    Crucial MX500 2 TB
    Antivirus
    Microsoft Defender
cereberus said:
I bet MS could pre-screen the feedback and sort into common themes? If copilot (or other AIs) is half as good as claimed pre-screening lots of replies should be a doddle.
Click to expand...

Or implement A.I. telemetry - and there won't be any need for a middle man. Could even use our own (PC) resources. And just send the results (debugged issue) - to be included in upcoming patch. That seems to be the future - unless, the privacy laws against A.i. get stricter... 🤷‍♂️
 

My Computer

System One

  • OS
    WinDOS 25H2
    Computer type
    Laptop
    CPU
    Intel & AMD
    Memory
    SO-DIMM SK Hynix 15.8 GB Dual-Channel DDR4-2666 (2 x 8 GB) 1329MHz (19-19-19-43)
    Graphics Card(s)
    nVidia RTX 2060 6GB Mobile GPU (TU106M)
    Sound Card
    Onbord Realtek ALC1220
    Screen Resolution
    1920 x 1080
    Hard Drives
    1x Samsung PM981 NVMe PCIe M.2 512GB / 1x Seagate Expansion ST1000LM035 1TB
pseymour said:
The company or the update type isn't really relevant. You roll out new features en masse, you get problems en masse.
Click to expand...
Perhaps there should be more restrictions on who can join Windows Insider -- I'd suggest like a little quiz that the ArchLinux Forum poses to users who wish to register -- this cuts down on people who really shouldn't be using "Insider type builds".

Cheers
jimbo
 

My Computer

System One

  • OS
    Windows XP,11 Linux Fedora Rawhide pre-release 45
    Computer type
    PC/Desktop
    CPU
    2 X Intel i7
    Screen Resolution
    4KUHD X 2
jimbo45 said:
Perhaps there should be more restrictions on who can join Windows Insider -- I'd suggest like a little quiz that the ArchLinux Forum poses to users who wish to register -- this cuts down on people who really shouldn't be using "Insider type builds".

Cheers
jimbo
Click to expand...
Especially Linux fans :lmao:.
 

My Computer

System One

  • OS
    Windows 11 Pro + Win11 Canary VM.
    Computer type
    Laptop
    Manufacturer/Model
    ASUS Zenbook 14
    CPU
    I9 13th gen i9-13900H 2.60 GHZ
    Motherboard
    Yep, Laptop has one.
    Memory
    16 GB soldered
    Graphics Card(s)
    Integrated Intel Iris XE
    Sound Card
    Realtek built in
    Monitor(s) Displays
    laptop OLED screen
    Screen Resolution
    2880x1800 touchscreen
    Hard Drives
    1 TB NVME SSD (only weakness is only one slot)
    PSU
    Internal + 65W thunderbolt USB4 charger
    Case
    Yep, got one
    Cooling
    Stella Artois (UK pint cans - 568 ml) - extra cost.
    Keyboard
    Built in UK keybd
    Mouse
    Bluetooth , wireless dongled, wired
    Internet Speed
    900 mbs (ethernet), wifi 6 typical 350-450 mb/s both up and down
    Browser
    Edge
    Antivirus
    Defender
    Other Info
    TPM 2.0, 2xUSB4 thunderbolt, 1xUsb3 (usb a), 1xUsb-c, hdmi out, 3.5 mm audio out/in combo, ASUS backlit trackpad (inc. switchable number pad)

    Macrium Reflect Home V8
    Office 365 Family (6 users each 1TB onedrive space)
    Hyper-V (a vm runs almost as fast as my older laptop)
pseymour said:
The company or the update type isn't really relevant. You roll out new features en masse, you get problems en masse.
Click to expand...
IMO,In the case of the Insider builds it is. We were warned of what could happen and chose to take the risk and joined the Insider channels. It's different when users don't have a choice.
 

My Computers

System One System Two

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    PowerSpec B746
    CPU
    Intel Core i7-10700K
    Motherboard
    ASRock Z490 Phantom Gaming 4/ax
    Memory
    16GB (8GB PC4-19200 DDR4 SDRAM x2)
    Graphics Card(s)
    NVIDIA GeForce GTX 1050 TI
    Sound Card
    Realtek Audio
    Monitor(s) Displays
    #1. LG ULTRAWIDE 34" #2. AOC Q32G2WG3 32"
    Screen Resolution
    #1. 3440 X 1440 #2. 1920 x 1080
    Hard Drives
    NVMe WDC WDS100T2B0C-00PXH0 1TB
    Samsung SSD 860 EVO 1TB
    PSU
    750 Watts (62.5A)
    Case
    PowerSpec/Lian Li ATX 205
    Keyboard
    Logitech K270
    Mouse
    Logitech M185
    Browser
    Microsoft Edge and Firefox
    Antivirus
    Webroot SecureAnywhere CE 26.1
  • Operating System
    Windows 11 Canary Channel
    Computer type
    PC/Desktop
    Manufacturer/Model
    PowerSpec G156
    CPU
    Intel Core i5-8400 CPU @ 2.80GHz
    Motherboard
    AsusTeK Prime B360M-A
    Memory
    16 MB DDR 4-2666
    Monitor(s) Displays
    23" Speptre HDMI 75Hz
    Screen Resolution
    1920x1080
    Hard Drives
    Samsung 970 EVO 500GB NVMe
    Keyboard
    Logitek K270
    Mouse
    Logitek M185
    Browser
    Firefox, Edge and Edge Canary
    Antivirus
    Windows Defender
Yes, you said that already.
 

My Computer

System One

  • OS
    Windows 11 Pro 25H2
    Computer type
    PC/Desktop
    Manufacturer/Model
    Intel NUC12WSHi7
    CPU
    12th Gen Core i7-1260P
    Motherboard
    NUC12WSBi7
    Memory
    64 GB Micron PC4-25600
    Graphics Card(s)
    Intel Iris Xe Graphics
    Sound Card
    on-board Realtek HD Audio
    Monitor(s) Displays
    Dell U3219Q
    Screen Resolution
    3840 x 2160
    Hard Drives
    Samsung SSD 990 PRO 1TB
    Crucial MX500 2 TB
    Antivirus
    Microsoft Defender
I think the problem is it has never occurred to anyone at MS why the phrase "Don't fix it if it isn't broken" was coined. In 30 years of computer repair and consulting, I can't remember a time when an update or some new feature didn't break something for somebody. Usually it's a bug that breaks the network or some other crucial application.
 

My Computer

System One

  • OS
    Windows 11 22H2 Pro (X-lite Micro 11 version)
    Computer type
    Laptop
    Manufacturer/Model
    Dell/ Precision 7680
    CPU
    i7 13850HX (20 cores, 28 threads)
    Motherboard
    Dell
    Memory
    32GB DDR5
    Graphics Card(s)
    Intel UHD/ RTX 1000 ADA
    Sound Card
    Realtek
    Monitor(s) Displays
    4K UHD Touchscreen
    Screen Resolution
    3840 x 2400
    Hard Drives
    Samsung 512GB system drive
    WD Blue 1TB game drive
    PSU
    240W AC adapter, 1800W when docked
    Internet Speed
    1 gigabit symmetrical
    Browser
    Firefox, Librewolf
    Antivirus
    None. Manully configured so nobody except me can change any critical system files. (Don't ask how, it's probably against some rule somewhere)
You must log in or register to reply here.

Latest Support Threads

Latest Tutorials

Back
Top Bottom