Back

AI usage patterns in software teams

135 points11 hourslinear.app
gkamal8 hours ago

This looks like measuring what is easy to do, rather than what really matters.

PR open counts, issues created , ceos/founders spending more time on linear don't automatically lead to better outcomes (in my experience they are often negatively correlated:-) )

onion2k4 hours ago

This looks like measuring what is easy to do, rather than what really matters.

Even that's hard. There aren't enough signals to attribute changes directly to AI, so these apps seem to correlate the signal that the user was interacting with AI to the changes they made e.g "Bob used AI at that time, and they opened a PR at a similar time, so Bob probably used AI to make that PR."

Until the tooling for gathering data on AI usage improves the data will be fairly interesting because correlations often point to something related, but won't be a source of truth.

Fordec4 hours ago

Yeah all of these along with raw token usage are metrics that were being used around December to February by people who just didn't have anything to go off yet.

Skill/Hook usage rates, budget spend, auto-approval rate, focus area heatmaps, MTTR, MTTD are all there now

hexasquid5 hours ago

I'd be interested to overlay, I don't know, customer satisfaction or anything that can show the follow-on effect of all this output. Linear won't have that information.

My guess is some will jump up (where the team has managed to make themselves move effective and responsive) and many will plummet (doesn't need explaining).

Then there might be something to look at.

onion2k4 hours ago

I'd be interested to overlay, I don't know, customer satisfaction or anything that can show the follow-on effect of all this output. Linear won't have that information.

Very few businesses can accurately attribute customer value to the work they do, especially once they're passed start-up scale. A mature company makes lots of small changes and they're rarely measurable.

AlexKalWork2 hours ago

This looks like a "We are so AI native and efficient!!" article. At least, they could delve deeper into how they define the metrics and how they collected the data.

sebiandev6 hours ago

this seems inappropriate. I think its a bad paradigm that just because you use a platform's service, they get intimate details about your usage. And for them to be so bold about publishing the statistics they've stolen from their customers data? Gives me a reason to never recommend my org use this platform.

clintonb5 hours ago

The data is aggregated, and you cannot possibly identify a single user from what's been published. I see no issue here.

giraffe_lady4 hours ago

I think their point is that there's business value in the usage data and linear is using that value in a way that benefits them but not the customers they got it from.

It reminds me of matt levine's reframing of insider trading where it's not about fairness it's about theft. You're supposed to get secret insights and use them to get an edge. What you can't do is get an edge for yourself with secret insights that your employer got.

So it roughly comes down to "that data is valuable and rightfully belongs to the originating company." Which then makes this a contract diligence type situation.

clintonb2 hours ago

My company uses Linear. The data presented in this blog post is worthless to me and the company. It can be crudely summarized as “agents and agentic development processes are conducting more Linear operations.” Duh!

whateveracct4 hours ago

lol isn't this what google said and yet..the NSA cometh

anon70003 hours ago

I’d rather it was published for free in a blog post than sold without my knowledge. As a linear user. This shit doesn’t matter, everyone in the industry know these kinds of stats are being tracked, I’m happy for a company to be transparent about it.

rightbyte1 hour ago

Why would a company want to leak its processes and workflows to another company in a capitalist system. Seems sloppy and a short sighted transfer of wealth to external stockowners.

humbleharbinger6 hours ago

Uhh that's how a lot of economic data works too. Guess how we get a lot of jobs data... ADP

sebiandev6 hours ago

Oh hey! My industry. Guess what? ADP doesnt just yoink your data. ADP conducts voluntary surveys on the scale of hundreds of thousands. Voluntary. ADP also pays for it for the most part. Do you think Linear conducted..voluntary surveys here?

jmtulloss3 hours ago

This is pretty interesting but I wish it would have been refined in two ways:

- The prose before the data appears to be AI generated. Not a big deal but it makes the reader work harder to figure out what's actually being said.

- Linear didn't control for their platforms AI changes over the past year. The platform has become much more AI integrated, so a lot of numbers will move. I'm not sure how you do it but this is only useful signal with a control.

hobofan3 hours ago

I think it's worth noting that headlines like "AI adoption has spread to every function" is only limited to roles covered/tracked by Linear.

Recent studies by e.g. Google show a much broader range of adoption.

jdw6410 hours ago

These days, my work has become: generate code for 20 minutes, then spend an hour reading it.

tankaiji9 hours ago

And then more hours cleaning it up and re-prompting.

nik2820006 hours ago

I program as a hobby, personal projects because I can.

I recently set up a local llm to see what the fuss is about and other than the few ringer solutions my experience is as you described. 2min promping, 5min waiting, 3hrs debugging or just doing it myself.

I am very likely doing it wrong, and it does speed up some aspects, but I wouldn't say I trust llm code any more than my own. Until it runs and throws an error, the llm is 100% confident that it has written perfect code.

nightmunnas2 hours ago

Models that run on (average) consumer hardware are not even close to comparable to models like Fable or Sol. Its like comparing an ant to the largest dinosaur.

anon70003 hours ago

A normal agentic loop will have the agent using a type system and basic tests to do some basic validation of changes. A good agentic loop would give the agent a very easy way to verify if it’s on the right track. I think agents are better than many humans at writing error free code (runtime errors, not bugs. The code could still be buggy or incorrect.)

+1
hypfer3 hours ago
jdm22124 hours ago

Try using Fable and report back. Local LLM is to Fable as Little Tike car is to a Porsche.

viccis5 hours ago

I don't think setting up a local LLM is a reasonable way to get a good idea of how enterprises are using this stuff.

TingPing5 hours ago

Local llms aren’t super exciting unfortunately.

danggggg9 hours ago

Why not just write the code yourself? To me it seems like methodically constructing the pull request by hand is probably faster than lazily prompting and re-prompting.

conradludgate5 hours ago

What I've observed is that by prompting for longer I get to keep my brain focused on the architectural ideas (networking, protocols, data structures, etc) rather than worrying about the most performant/elegant implementations.

I always enjoyed writing code and I am very good at writing very performant and elegant code, but it would sometimes come at the detriment of focusing on the code and not the design.

denkmoon9 hours ago

because my manager will ping me and say "anon you aren't prompting enough" like they never heard of Goodhart's law before.

+1
what6 hours ago
viccis5 hours ago

In my experience?

It used to be that one person had one to three codebases they knew intensely at my company. If you needed a bug in codebase X fixed, person Y was the one to do it and if they aren't available, person Z can do it, just not as quickly.

Now every person on my team has to handle tickets for every single codebase. There are about two dozen different large codebases involved here.

It's a ludicrous antipattern because person Y still needs to review the PR that person A generated for codebase X, and it will take them about as much time to wrangle the 2000 line PR (oh boy do LLMs love their mocks for unit tests) as it would have been for them to do the 50 line code change.

On top of that, it has "allowed" us to add feature after feature onto codebases not designed for them without refactoring. Is it good that this Flask API went from a purpose built service that interacted with the data analytics for product A stored in database X, and now our sales guys can sell product B, C, and D stored in database X? Uh, I'm sure it's great for them. Oh, and now it all can be stored in database X, Y, or Z depending on what the customer wants or what sales promised them. Great. Now I'm looking at a Flask app.py that's 12,000 lines of repeated code.

It has allowed poor designs to still produce working code. For a while. We seem to be getting a lot of bugs lately that look really bad to customers because it's for really simple shit. And I can't help but notice that happening to all the various products and sites I use too...

sandeepkd5 hours ago

Companies are tracking token usage across the board. You are in trouble for too less or too many. Unfortunately the token usage is the only measurable thing for most folks so everyone is playing the game, otherwise how else would Anthropic and OpenAI make the money

jdw649 hours ago

Writing code directly takes longer to warm up. Usually, I'd keep tens of thousands of lines in my head. In the past, I spent a lot of time designing error propagation and execution contexts. (Talented people might figure it out right away, but unfortunately I don't have that kind of talent.) So I'd have to think about things like Result<T> and how far to propagate errors—and worry about whether my approach would conflict with the existing codebase.

But these days, AI just generates code following the existing patterns of the codebase. In the past, staring at a blank screen meant going through a checklist of things to design—starting from policies and writing everything down step by step. Now, I just ask AI and it gives me a template—which is great. Then if the AI makes a mistake, I fix it manually.

Of course, I still hand-code sometimes—but only in the areas I enjoy. Most of the time, I use AI coding. Both are fun, and they complement each other in interesting ways. Doing both together is actually enjoyable.

+1
nozzlegear6 hours ago
+1
skydhash9 hours ago
johnxianren6 hours ago

Felt that. I already gave DeepSeek the HTML and it still said the UI was good to go, then told me it has no vision.

ReptileMan53 minutes ago

Like the Titan submarine team's moto mine is - real men test in production.

The LLM produce so much code that the best I can is skim and look for obvious flaws, also pass it trough adversarial one.

whateveracct4 hours ago

I spend 45 minutes writing it. then i git commit and move on cuz i made something good.

who is winning here? lol

mulanroo7 hours ago

[dead]

danggggg9 hours ago

That's gotta be at least 10x or 20x more efficient than the old way of doing things.

dullcrisp9 hours ago

It could be. Or it could be 1x, or 0.2x. You don’t have enough information to make that judgment.

danggggg9 hours ago

I was joking. The workflow doesn't seem particularly fast or engaging in my opinion. AI code generation doesn't seem worthwhile to me.

+1
dullcrisp9 hours ago
+2
slopinthebag9 hours ago
cadamsdotcom3 hours ago

Nice data!

Tim (author) if you're there: it'd be amazing to see the split of which agents people are using, if you have that data.

agnishom6 hours ago

I didn't know Linear has "AI features". Linear is boring, but that's actually fine by me.

I use LLMs to write my code, but this does not show up in this data.

greatgib9 hours ago

"Pull requests are up 111% in two years". Would be more honest to say that the number of pull requests "detected" by linear are up XXX%. Because it only works if you setup git repo tracking and use it properly. And at that point it is not obvious if more teams are using linear and using it correctly, or if the number of PR really increased that much!

slopsosn7 hours ago

The AI Slopologists strike again. More garbage by garbage people.

prolly971 hour ago

Is this just an opinion? If so, fair.

If it's an attempt at rebutting their claims etc, it'd be easier to interact if you provided some data, or concrete observations :)

subarctic7 hours ago

Can't tell if you mean the people the article is talking about or the article itself

what6 hours ago

¿Por qué no los dos?

0xbadcafebee9 hours ago

> Time spent on customer requests, docs, and projects held steady [..] AI has so far changed how teams execute far more than how they decide what to build

I think the measurement for this may be flawed. We do mostly use AI to decide how to build. But what we build is influenced by AI-driven research into a problem or task. That's largely done in coding and desktop AI tools, not Linear Asks/AI.

I'm working on accelerating my team's work by implementing AI-driven code pipelines with guardrails to eliminate as much unnecessary review time as possible. Also making a chatbot for turning repetitive tasks & PRs into buttons, and an "architectural guidance" chatbot that gives advice tailored to our business, software/system architecture, cloud, standards, etc. This puts AI and automated jobs in the center of both how (automated task) and what (architecture guidance).

But this has a not-so-great implication for Linear. With my tools, a human never has to touch a ticket, so we could use any ticketing system with an API or CLI. Linear is a great product because they made a great interface. What happens when I replace their interface with a chat bot?

akashy1233 hours ago

[dead]

coinyong4 hours ago

[dead]

qqt6 hours ago

[flagged]

alexwrich6 hours ago

[flagged]

CircuitSeuss10 hours ago

[dead]

Phill_Madd8 hours ago

[flagged]

jocelyner6 hours ago

[dead]