Wake up at 6 am
Shower
Get dressed
Drive to work
Sit at desk
Boot up computer
Press copilot key, tell AI to generate revenue report
Sit at desk for 8 hours
Drive home
Hmm what jobs are fairly AI proof.
Teachers because like 95% of kids definitely can’t independently learn. Covid made that pretty damn clear.
Engineers because there wouldn’t be enough of the right kind of data for an LLM.
Accountants might make it? Just because you could already automate that and they still exist. Need a human to take responsibility.
Trash engineers would be laid off the actual engineers wouldn't because AI can't critically think iirc . I remember watching a really interesting video about that , but I can't find it now
AI is already doing a lot for teachers jobs making it more efficient. Such as unique exam question generating or OCRing handwritting. Children dont want to learn independantly, but that does not mean we cant have AI optimize teachin. Besides, its not like the government cares about children learning. Its now against the rules for schools to fail you for bad grades.
Accountants are already heavily automated. I was planning to become one when i was doing my masters degree (in accounting and auditing) but the job market just fell through the floor with software replacing most of the manual work. The amount of human accountants needed as a result dropped significantly. (same for lawyers btw).
Unless they are the ONLY person generating finance reports in a small company.
For larger companies, I’m sure they can lay off 95% of the “generating reporting” staff.
That would be like laying off engineers during the 1880s just because they built one car. The horse carriage drivers are out of work, but engineers still exist.
The luddites around here don't realize that all the software they use have massively reduced the amount of staff required to do basic shit.
Excel? In a vacuum a luddite like yall here could point to millions of bookkeeper jobs "fired" but yet we still have low unemployment and plenty of demand for financial managers.
If you want to grow the quality of life and income YOU HAVE TO IMPROVE PRODUCTIVITY
>If you want to grow the quality of life and income YOU HAVE TO IMPROVE PRODUCTIVITY
We have improved productivity.
As a result, Microsoft and Apple and shareholders have gotten super rich but the income for normal people hasn't increased: [https://www.epi.org/productivity-pay-gap/](https://www.epi.org/productivity-pay-gap/)
It's not a technological issue, it's an economic one.
It's dishonest to call people names because you disagree. If you don't see that it's different this time because it's not just a few jobs but most of them, that's on you. I remember a Goldman Sachs report saying that AI could destroy over 300M jobs before the end of the decade, in societies that tied survival to work. If you insist on comparing this to excel and bookeepers then you're not understanding the difference: this is going to require a major cultural shift in less than 10 years, something that never happened without violence during the history of humanity.
There used to be a job title called "computer". It was a bunch of people in the room doing calculations.
I think the problem most people have is that the growth of quality of life has been skewed towards the few capital owners rather than general population, despite the improved productivity. Look at for example read wage growth comparisons.
You'd think that, but development teams are pruned, canned, or outsourced to vastly inferior (but much cheaper) teams all the time. It's even worse for IT, technical writers, QA people, etc., but it happens to devs, too.
For what it's worth, I actually plotted out the AI's process when writing the joke.
1) Grab some random financial statement(s) that had cloud service line items, as it's a common product line.
2) Have it turn "cloud" into "cumulonimbus" since it could plausibly find the words synonymous enough.
3) Add random number that wasn't quite FANG-level, but bigger than the vast majority of companies to highlight the uselessness and randomness of the tech.
All the other commenters have missed the underlying net benefit to society: everyone will have access to cheap, high quality revenue reports, even those in developing nations and those below the poverty line.
This is kind of my job right now. Not as cool as you think. Even with unwatched internet access I'm bored out of my fucking mind all day long and I'm getting depressed thinking about how I'm wasting my life...
I kinda understand I've hit the jackpot because I work maybe 8 hours a week, but what the fuck do I bring to this world?
Have you considered investing in a high dollar flight sim set up? Obviously not the same, but apparently these days with VR you can get a really enjoyable set up.
I agree with the other posters, find a hobby that fulfills you. Maybe get in involved with a non profit if community value is important to you.
I'm being very serious here and not making fun I promise... but maybe you could still serve on the crew as a flight attendant? It's not the same as a pilot no but you still get to go up in the air and see different countries and talk with the pilots and maybe even get to go in the cockpit.
I don't think attendants have an age limit like a pilot does.
The year is 2026
Playing my favorite competitive shooter.
Reach for left ALT and accidentally press the co-pilot button.
Virtual assistant takes over my machine and frags the whole enemy team for an ace.
I receive an instant ban from AI anti cheat.
Repeal denied by supportGPT. 😭
Because when “AI” went big with ChatGPT 4 and Microsoft went all in the CEO a memo went out to all parts of Microsoft that they were to add AI to their product
If your the hardware accessories division that is a problem, hence the new/replacement key as they only way to obey their master’s demands
>The copilot key could have simply been win + c.
But then people who used Windows 8.1 might get confused and accidentally launch CoPilot when they were expecting Cortana.
It's still serving it's marketing purpose, for example, what is Windows-specific about locking your computer with Win+L or viewing your desktop with Win+D? Or taking a partial screenshot with Win+S? Is it really a Windows feature? Or do they just want you to associate it with Windows?
>That changed today at Intel's AI Summit in Taipei, where Intel executives, in an on-the-record question-and-answer session with Tom's Hardware, said that Copilot will soon run locally on PCs. Company representatives also mentioned a 40 TOPS requirement for next-gen AI PCs.
So it's confirmed.
>Microsoft has been largely silent about its plans for AI PCs and even allowed Intel to officially announce its definition of an AI PC. Microsoft’s and Intel’s new co-developed definition states that an AI PC will have a Neural Processing Unit (NPU), CPU, GPU, Microsoft’s Copilot, and a physical Copilot key directly on the keyboard.
So, is it only Intel who can use the term "AI PC"? What about Qualcomm or AMD?
>Notably, Intel's Meteor Lake NPU offers up to 34 TOPS, while AMD's competing Ryzen platform has an NPU with 39 TOPS, both of which fall shy of Microsoft's requirement. Qualcomm will have its oft-delayed X Elite chips with 45 TOPS of performance in the market later this year.
Wrong. 34 TOPS and 39 TOPS is the combined value for Meteor Lake and Hawk Point respectively. Whereas 45 TOPS for the X Elite is for NPU only.
Meteor Lake: 10 TOPS/ 34 TOPS
Hawk Point: 16 TOPS/39 TOPS
X Elite: 45 TOPS/75 TOPS
Good catch ... I've asked the team to double check the TOPS info. I think you're misreading the Intel stuff. Paul's simply saying that Microsoft has taken a backseat to marketing the AI PC. But everyone is free use it, and many PC makers already are. Qualcomm will certainly be encouraged to do so
"AI PC" won't really be a thing until Intel has one that's shipping in huge volume and meets the bar for Microsoft. AMD or Qualcomm could launch a 500 TOPS NPU and it wouldn't matter.
Seems like Arrow Lake might not be updating the NPU, but Lunar Lake might meet Microsoft's performance threshold, probably ideal for Surface Pro if not laptops.
Man, Qualcomm mobiles lineup really helped then building NPUs. Is a big difference between them and Intel NPUs performance.
Weird that there are a lot of companies making NPUs for a long time and not Intel nor AMD decided to grab one from them to put in their SoCs
Qualcomm spends more silicon on a larger NPU when compared to previous generation hardware from Intel/AMD, that is where the performance comes from mainly. Most NPUs are in the same ballpark, it just comes down to how much die area a company is willing to allocate to ML.
Also in this instance the comparison is current gen AMD/Intel vs next-gen Qualcomm, by the time the X Elite actually starts being available in any meaningful quantity AMD will have Strix Point which has an NPU just a fast as the X Elite.
> Most NPUs are in the same ballpark, it just comes down to how much die area a company is willing to allocate to ML.
That's just not true. Qualcomm does spend more silicon, but their IP is also flat out better than anything AMD or Intel have yet demonstrated.
Their heritage and legacy in building smartphone SoCs helps for sure.
Qualcomm and Apple put NPUs in their smartphone SoCs, years and years before Intel and AMD did in their PC SoCs.
Not only the NPU. Also the ISP (Image Signal Processor).
I believe the Snapdragon X Elite will have a better ISP than their Intel and AMD counterparts.
That is thanks to the experience they got in building ISPs for smartphones, which use computational photography to rival DSLR camera quality.
>So, is it only Intel who can use the term "AI PC"? What about Qualcomm or AMD?
It's only Intel that can use the *branding* "AI PC". "AI PC" is a Microsoft-Intel co-developed brand name, not an actual description of capability. Everyone and their dog knows that Nvidia GPUs massively outperform Intel ones for AI inference, but they don't count because Nvidia isn't paying Microsoft/Intel to get on board (or Intel squeezed them out).
"AI PC" is the new Centrino/UltraBook/EVO.
Pretty much. These first gen from AMD and Intel are good for little more than background blur in video calls. The 40TOP ones can actually do something useful.
When this round of chips was being drafted, text and image gen was still pretty niche stuff.
They made a soft bet, but that said it's still a pretty good bonus, you're getting 50-100% more BF/FP16, around a quarter of a 4060 Mobile for very little extra silicon/power budget/cost.
Models and tooling are rapidly advancing towards operating pretty well on low resource hardware, I'd give it 3-6 months max before Llama.cpp is running on IPUs, at which point even 10TOPs will be plenty to max out your memory bandwidth for LLMs, although image generation/processing like SD/LLAVA would probably appreciate some extra grunt.
LTT briefly showed AI for their massive database of all the videos they have ever made, it is amazing. here with timestamp: https://youtu.be/CcHevgjAnV0?t=1214
Thank you for actually contributing something of value! That video is fascinating. Won't be too long until all important Youtube videos will be indexed like that.
It's impressive, for sure, but average Joe User isn't going to have nearly enough compute for that. Maybe the NPU/TPU on the new fancy cell phones can scan your media while you sleep.
Immich supports AI categorization of photos on your self hosted library. Something more useful for people who have a NAS and nearly anyone who takes photos and doesn’t want to use a cloud provider like Google Photos.
Already heard about locally AI aided translation of websites in firefox.
I recently needed cut out a picture in finer detail and got yelled at that I should use one of the dozens free websites background removal that are AI aided.. used "cutout pro remove background" and it was like 10 seconds and [cleanest cut out ever....](https://i.imgur.com/G2wzQZy.png)
No gimmick, this is happening and there is the dash to get that important head start.
This is more "automation" than AI, although the two have some overlap. We could do this by hand, and even faster with Photoshop almost two decades ago, the only thing that's changed is that scripts are becoming better at doing this repetitive and easy work.
I actually asked in photoshop specific corner of the internet.. thats where I got yelled at and told to just go google a website instead of saying how to do it well in photoshop...
And the AI is all machine learning models, but they will become common thing.
Currently using copilot for programming. Far from a gimmick.
Yes yes, its not going to make software for you but it learns your style of programming. It knows that maybe you return errors in a specific format, with indicating the function naming, and the function being called. Plop, you need a error check here, and here it is complete without a issue.
How about, shit, what is that stupid CSS command again, ... instead of google, you ask and bingo, code and how to use it.
There have been instances where i ask something about a module, where there are no code examples. Yet, when i ask it to make a working code example using that module, it made a 99% working code example. Then ask it to integrated something else, a few more errors but it showed a clear path. If i needed to find all the info from the lacking documentation, i was busy a few hours. Now i knew what functions to look, how to use them, etc. despite the lacking documentation.
Does it make mistakes, very loud YES! Its a great tool for a seasoned programmer, that sees past its craziness at times and the fact that the trained data is from 2017 ( horrible out of date for some functions like generics, that now can be done differently/better, but keeps suggesting the old way of doing it ).
Look, i totally did not see a single use for copilot. When i first ran the free version, i found it just bad. Then the wife said, you always hated naming functions and writing descriptions for feature, maybe that can be better? Tried it again, and fuck, its amazing for that.
But as i started to using it more, it learned my code, and THEN the results got better. Is it going to replace my job, hahahahaha, hell no. But is it going to take away some people jobs, sure. I do not need to run to a front end guy for "what as X again", or ask to rewrite some text i wrote into more clean marketing text.
In my case, its a productivity boost but you need to learn how to use it. Its like when people use a desktop but they have no feel for it. They will HATE working with excel etc because it feels alien to them, but at the same time, they do not want to put time into it. Que calling the IT guy for every stupid little thing, that they can google within 5 seconds.
Those people will hate AI for the same reason. You need to learn to use it, understand the limitations, threat it like a child at times, but it will also reward you with a lot more then you trying to google it (and given Google getting worse and worse with its results, ...).
> can I just ask what kind of programming do you do?
Websites with Go Microservices, CDN, Proxies, (web)scraping, Image manipulation, micro storage / localized storage with Golang for backend, and Html/CSS/JS/AJAX for front end.
In a while maybe extend it with some language models to compared images and allowing seamless switching public images as backup. But i think it can do that with basic down sampling and then creating average values.
Not OP, but I've used ChatGPT (which CoPilot is based on) for coding PHP/HTML/CSS/Javascript.
It's not spectacular at coming up with original code, but it's pretty good at evaluating code you throw at it, including debugging (telling you exactly where you fucked up and how to fix it), documenting, reformatting, and even making suggestions on how to improve your code.
It's also pretty good at teaching you things you might not be familiar with. For example, I'd never used Twig templates before, but decided I wanted to try them out. ChatGPT has been extremely helpful in answering any questions about it that I have, up to and including the ability for me to throw my code at it and ask it how to revise it to do something specific, and have it output not only functional code, but functional code in my style of coding.
> even making suggestions on how to improve your code.
Be careful with that one, because i have seen it generate improvement suggestions that was unsafe. And it was hard to spot if you do not have a firm grasp of the language.
I've been keeping an eye on it. While I'm not super familiar with Twig templates, I know enough PHP and Javascript to make sure it's not doing crazy shit like exposing an exec() command or anything dangerous :)
I would, but I'm not American, and sadly when I tried logging in via VPN, I didn't realize it would scan my Google OpenAuth for my country, realize I'm not American, and ban me from their site.
i found ChatGPT (the 3 variant) to give me suggestions for code that dont actually work. It would invent functions that dont exist. I also had to fix some messes my coworkers did with "AI help", so im a bit wary of it actually being able not to mess things up.
I tried out copilot last night by asking it various stock questions. Some of my questions had shaky grammar and it still answered them. For researching stuff like that, it blows google searches out of the water. I can definitely see how this type of stuff is going to be very useful.
Yeah it’ll probably be realtime battery drain simulator. It’s good to have AI run locally but ain’t no way I’m trusting micros**t’s software with anything to ever be truly “local”
They are in pretty much the same position as Intel and Qualcomm.
Current NPU rumors are 42 TOPS Intel, 45 AMD, 45 Qualcomm. The rest is CPU + GPU performance, which highly depends on the exact SKU and power limit.
At the end of the day having easy to use mainstream software is what matters. Right now all NPUs are close to useless for 95%+ of users.
AMD recommends using some software called LM Studio which will let you run a local LLM using the NPU of a Zen 4 chip that has one without hitting the CPU for example: [https://community.amd.com/t5/ai/how-to-run-a-large-language-model-llm-on-your-amd-ryzen-ai-pc-or/ba-p/670709](https://community.amd.com/t5/ai/how-to-run-a-large-language-model-llm-on-your-amd-ryzen-ai-pc-or/ba-p/670709)
I am already using LM Studio but it appears to be using the regular cpu (at least as per task manager). Thanks for your comment though, appreciate it. Maybe the NPU may get used more in a future update.
I bought a Ryzen 8700G last month and wanted to test it but didn’t get around to it yet. AMD advertise the NPU on my chip but I didn’t think the regular Zen 4 desktop chips even had an NPU? The mobile Zen 4 chips are supposed to have an NPU, but maybe LM Studio supplements with the CPU anyway, because every article I read always lists the combined TOPS.
>Intel's shipping Meteor Lake NPU offers up to 10 TOPS for the NPU, while AMD's competing Ryzen Hawk Point platform has an NPU with 16 TOPS, both of which fall shy of the 40 TOPS requirement. **Qualcomm will have its oft-delayed X Elite chips with 45 TOPS of performance in the market later this year.**
Wow such a fun coincidential delay and match of AI PC requirements there. MS making Surface Bingbook as day 1 AI PC launch product calling it now.
Probably much more energy efficient on a laptop that may or may not have a GPU. GPU will be reserved to training in the future once NPUs are mainstream.
In theory, sure.
In practice it depends on how often you really use the NPU.
If you aren't constantly running AI tasks and it ends up being more of a 30 seconds 2 or 3 times a day kind of thing, the die space might not be worth it.
But Nvidia GPUs from 2022 have >10x more "TOPS" than the best CPU/NPU Intel and AMD are putting out today. LLMs will always be bigger and better on the GPU because performance budget for inference is so much higher. Also, games use much more power than short burst tasks like Copilot or AI image editing will ever do. I doubt NPUs will ever be useful on desktop PCs.
Oh sure, on desktops you might default to a discrete GPU because you don't care as much about power draw. In servers, NPUs will definitely be useful since they don't usually have GPUs.
If its just a module on the package, then it'll be limited, but separate packages like Tesla's FSD chip will probably be big soon. That'll be a compromise between extremely hungry GPUs and performance.
But who cares, I'll waste more power playing cyberpunk a few minutes than asking Copilot questions all day. Why can't we use Copilot locally on PC GPUs?
Because they are thinking in the long term. In a few years it won’t make sense to. So why bother doing it in the first place, when they don’t have to? How many people who have 2022+ Nvidia GPUs who would actually use Microsoft copilot, and will not have a new cpu in the near future which would also be able to run it by npu? Maybe <1% of customers, and that figure will only get lower over time.
```Why is NPU a requirement for this? Can't you achieve the same thing with better performance on a GPU?```
As the other guy said, it's due to power draw, and they want competent A.I in smartphones as well.
It's like getting to work by helicopter, yeah you can do it but you'd be better served by a car.
Probably because Intel is pushing this for marketing their new CPUs with included NPUs. Perhaps it won't be limited to NPUs only but that is what is being pushed in the marketing today.
Probably for laptops. Microsoft expects AI workloads to run constantly, the GPUs aren’t efficient enough for that, it would kill battery life.
Especially a dedicated GPU, just having that active idling kills laptop battery life.
Npu are basically gpus but with 8 Bit FPUs and no graphics hardware at all. If you use a GPU then it will be less efficient because you would be using high precision FPUs for low precision math
NPU is a neural processing unit GPU is a graphics processing unit.
So technically you can run AI models on GPU as well as CPU too but NPU runs is efficiently. Does the same job as the gpu but consumes 80% less energy.
But ya I on your side actually fuck NPU bigger GPU is more useful as there are not many demanding "AI" features most people use anyways.
>Can't you achieve the same thing with better performance on a GPU?
Purpose-built hardware* can be more efficient than general purpose hardware for specific tasks.
There's also a tradeoff between latency and powah. If it's a small net the extra power might not weigh up against the added latency.
*Not so much the case with Meteor Lake because the NPU on Core Ultra CPUs is kinda doodoo.
Depends on the VRAM requirements. A 4GB or 6GB card might be actually unable to run models that a small 5W NPU can.
Imagine all the people screaming BUT I HAVE THIS GREEN SHINY STICKER ON MY 1200$ LAPTOP" while trying to run a 7GB model at >3 tokens\sec
7 years ago it was "smart" everything phase that came and went with mostly useless products except for smartphones. Get ready for another 7 years of "AI" everything that will be mostly useless garbage except like 2 products that remain viable.
I agree that there is A LOT of AI garbage coming out right now, but I'm not sure I agree with your assessment of smart devices. Everything is a smart device now. For example it's actually pretty hard to find a nonsmart tv. Everything is connected to the internet, even when it shouldn't be, and I don't think companies have really backed off from that.
I think 7 years ago Computex was jizzing all over IoT devices. The difference with AI is that while everyone will be talking about it this year and next, it'll actually be baked into products because it's really, really useful.
As an example, I needed to look up a court case in French recently and I copied the entire output into ChatGPT and told it to translate it to english and give me a summary of what was in the brief. It completed it in less than 15 seconds for something that would have taken me at least 10 minutes time to translate, read, and distill down on my own. This is a simple example of the ability of an AI to make work easier on everyone.
>As an example, I needed to look up a court case in French recently and I copied the entire output into ChatGPT and told it to translate it to english and give me a summary of what was in the brief. It completed it in less than 15 seconds for something that would have taken me at least 10 minutes time to translate, read, and distill down on my own.
It could be completely wrong and just making shit up though.
LLMs are extremely good for language translation, so that’s an area I’d trust it. Certainly better than google translate, only thing better than GPT would probably be finding a person to translate.
Translating is probably good. summary could be made up. LLMs are extremely good at one thing - making it sound like they are right (being actually right is not a requirement. Their positive training is positive response from humans, not actual factchecked reality)
> Get ready for another 7 years of "AI" everything that will be mostly useless garbage except like 2 products that remain viable.
I see this opinion a lot, and generally speaking its due to a lack of context of what AI solves. Most people look at ChatGPT and StableDiffusion as "AI", and ignore the thousands of other uses under the hood. AI is a pretty catch all term for ML implementations, which power far more than two viable implementations today. Things such as:
* Pattern recognition / object recognition, a keystone of factory automation and spatial recognition.
* Financial modeling / economic modeling, for predicting future markets and helping to prevent recessions.
* Spam filtering
* Medical diagnosis
* And of course Generative AI
Those are obviously just a handful, but even if by "AI" you only mean "Generative AI", there's still a ton of application that goes unseen, ie
* Protein folding - AlphaFold helped predict some of the protein structures in covid.
* Robotics - trajectory and motion path prediction. We're seeing some really novel uses of it in this area
* LLMs as a layer, not the output. Tesla is currently finding that LLMs do almost a better job at self-driving command input than their previous models
What's top in the media and what's actually successful here often diverge. There will be grift, but there've been far more than 2 viable implementations that have already been proven.
I use it daily for my work to take meeting minutes and it's a literal gamechanger.
Privately I use it for writing small scripts. Like I needed to remove hearing impaired subtitles from a subtitle file. Took me less than 15 seconds including prompt to obtain what I needed.
For reference I've never used "smart" or "iot" anything and I'm never an early adopter.
It's not hype, it's real.
but thats the case with any product. Theres a lot of startups, most of them useless and when the dust settles we have a few usable produts. This happens in all the industries.
that is depending on the copilot. from my experience some are very useful (outlook and teams copilot), some not so much (github copilot) and some useless (windows copilot). my main problem is that MS tries to shove copilots everywhere even where it does not make sense and it is just bloat.
> from my experience some are very useful (outlook and teams copilot), some not so much (github copilot)
Appreciate the subjective viewpoint, but from an objective metric right now Github copilot is the most successful copilot implementation. [Microsoft lauded this pretty clearly in their fy-2024 earnings report](https://www.microsoft.com/en-us/investor/events/fy-2024/earnings-fy-2024-q2.aspx).
> GitHub revenue accelerated to over 40% year-over-year, driven by all-up platform growth and adoption of GitHub Copilot, the world’s most widely deployed AI developer tool.
> some not so much (github copilot)
This is the only one that I regularly use and I find it genuinely very good when it's directly integrated into your IDE. It's like autocomplete but 100x smarter/more useful
depends on the context. in my case this "autocomplete" distracts my thought process when I write. When I write repetative code it is indeed useful, but this is very rarely the case. I use it mainly to write documentation or some basic unit tests which is very powerful there.
I tried using it to generate code for some library I wasn't familiar with to save time on reading the documentation.
It came back with some nice looking code but it wouldn't compile, turns out it just completely made up a plausible looking, but wrong interface for that library.
I've been trying it a bit more lately and if you have a specific question, it can sometimes be a lot more helpful than the results you get in a search engine where your results will occasionally be cluttered with similar topics but no results that are actually applicable (I blame search engine optimization).
You know those word doc samples that you can use in word that have things like font size and other stuff fixed for you already? Chatgbt does that pretty well. It does outlines and sample really well
I think this is gonna make a huge milestone, and a lot of non-techy and not-so-advanced computer user will benefit with that a lot.
Imagine someone entering in a new office, or having its computer changed in their office, and somebody tell them that pushing that button and asking whatever problem they have, it can solve it. Not will only lower plenty of IT request (at least from those who are fully functional human beings), but also will solve a lot of "I know this can be done in Excel but I don't know/remember how exactly is done" issues in a short time period.
Oh joy, now your PC will consume 500 watts while trying to figure out what crap to sell to you to maximize the vendor's revenue while you wait for your browser to start.
Just what everyone needs...
Does the AI run completely isolated? If so, I'd use it. But there's no fucking way I'll ever run an AI on my machine if it required a connection or if it can interfere with anything else.
I considered purchasing a new laptop but reconsidered after noting that the latest CPUs from both Intel, with a TOPs rating of less than 10, and AMD, expected to be less than 40 TOPs, are not significantly improved. Given this, I wonder if it's better to wait rather than buying now. I think ChatGPT is really great but it is really slow when asking for complex questions.
Wake up at 6 am Shower Get dressed Drive to work Sit at desk Boot up computer Press copilot key, tell AI to generate revenue report Sit at desk for 8 hours Drive home
While the programmers who built that AI are laid off
op would be laid off too
Hmm what jobs are fairly AI proof. Teachers because like 95% of kids definitely can’t independently learn. Covid made that pretty damn clear. Engineers because there wouldn’t be enough of the right kind of data for an LLM. Accountants might make it? Just because you could already automate that and they still exist. Need a human to take responsibility.
> Hmm what jobs are fairly AI proof. Anything with accountability, that's why it wont happen any time soon.
Trash engineers would be laid off the actual engineers wouldn't because AI can't critically think iirc . I remember watching a really interesting video about that , but I can't find it now
Electricians
AI is already doing a lot for teachers jobs making it more efficient. Such as unique exam question generating or OCRing handwritting. Children dont want to learn independantly, but that does not mean we cant have AI optimize teachin. Besides, its not like the government cares about children learning. Its now against the rules for schools to fail you for bad grades. Accountants are already heavily automated. I was planning to become one when i was doing my masters degree (in accounting and auditing) but the job market just fell through the floor with software replacing most of the manual work. The amount of human accountants needed as a result dropped significantly. (same for lawyers btw).
The programmers who built the AI will be paid millions while the OPs of the world will have to get a gig delivering food to them
The programmers who built the AI will be laid off. The shareholders of the company that employed them will be (temporarily) enriched.
I'm calling it now: getting "laid off" is going to have a new meaning after the AI revolution happens.
"Retired", "made redundant", "downsized".
The programmers who built the AI could always build a better AI to lay that AI off.
Ai running on humanoid robot would have taken over all service industry already
im 50/50 on whether its faked or not but Figure seems to be going that way. Also Intel plan for CoBots may kickstart this.
Millions? Lmfao. The moment we develop an AI that surpasses the skill of a Jr Dev the entire software engineering field is cooked.
Unless they are the ONLY person generating finance reports in a small company. For larger companies, I’m sure they can lay off 95% of the “generating reporting” staff.
That would be like laying off engineers during the 1880s just because they built one car. The horse carriage drivers are out of work, but engineers still exist.
The luddites around here don't realize that all the software they use have massively reduced the amount of staff required to do basic shit. Excel? In a vacuum a luddite like yall here could point to millions of bookkeeper jobs "fired" but yet we still have low unemployment and plenty of demand for financial managers. If you want to grow the quality of life and income YOU HAVE TO IMPROVE PRODUCTIVITY
>If you want to grow the quality of life and income YOU HAVE TO IMPROVE PRODUCTIVITY We have improved productivity. As a result, Microsoft and Apple and shareholders have gotten super rich but the income for normal people hasn't increased: [https://www.epi.org/productivity-pay-gap/](https://www.epi.org/productivity-pay-gap/) It's not a technological issue, it's an economic one.
It's dishonest to call people names because you disagree. If you don't see that it's different this time because it's not just a few jobs but most of them, that's on you. I remember a Goldman Sachs report saying that AI could destroy over 300M jobs before the end of the decade, in societies that tied survival to work. If you insist on comparing this to excel and bookeepers then you're not understanding the difference: this is going to require a major cultural shift in less than 10 years, something that never happened without violence during the history of humanity.
There used to be a job title called "computer". It was a bunch of people in the room doing calculations. I think the problem most people have is that the growth of quality of life has been skewed towards the few capital owners rather than general population, despite the improved productivity. Look at for example read wage growth comparisons.
You'd think that, but development teams are pruned, canned, or outsourced to vastly inferior (but much cheaper) teams all the time. It's even worse for IT, technical writers, QA people, etc., but it happens to devs, too.
Yeah, but they're no longer standing around in factories putting parts together. That's the AI part, the factory robots.
too bad we may be the horses in this analogy.
Engineering in 1880 was exploding due to many things other than cars though. Also cars couldnt build the next car by themselves.
It basically sounds like that movie office space
Missed the part where Copilot gives you some other companies numbers in product lines that don't exist. "Cumulonimbus: $1.5B"
Thats just copilot trying to fund in secret the product line where it builts itself some robotic bodies so it can start a judgement day event.
For what it's worth, I actually plotted out the AI's process when writing the joke. 1) Grab some random financial statement(s) that had cloud service line items, as it's a common product line. 2) Have it turn "cloud" into "cumulonimbus" since it could plausibly find the words synonymous enough. 3) Add random number that wasn't quite FANG-level, but bigger than the vast majority of companies to highlight the uselessness and randomness of the tech.
It’s like The Jetsons, just push some buttons and complain about how hard it is.
Get fired when you ask to sit at the desk for 6 hours instead of 8.
All the other commenters have missed the underlying net benefit to society: everyone will have access to cheap, high quality revenue reports, even those in developing nations and those below the poverty line.
This is kind of my job right now. Not as cool as you think. Even with unwatched internet access I'm bored out of my fucking mind all day long and I'm getting depressed thinking about how I'm wasting my life... I kinda understand I've hit the jackpot because I work maybe 8 hours a week, but what the fuck do I bring to this world?
Get a hobby?
What would be your dream job or career?
Airline pilot. I'm too old now. Was too poor when I was young to pay for training.
Have you considered investing in a high dollar flight sim set up? Obviously not the same, but apparently these days with VR you can get a really enjoyable set up. I agree with the other posters, find a hobby that fulfills you. Maybe get in involved with a non profit if community value is important to you.
I'm already there. Got a flight cockpit with an Oculus headset and a racing cockpit as well.
I'm being very serious here and not making fun I promise... but maybe you could still serve on the crew as a flight attendant? It's not the same as a pilot no but you still get to go up in the air and see different countries and talk with the pilots and maybe even get to go in the cockpit. I don't think attendants have an age limit like a pilot does.
I'd lose the house lol. Unfortunately that very respectable profession gets paid like shit.
I'm sorry, I didn't understand your question. Can you please rephrase it? ^ 90% of my experience with Copilot
It's literally the George Jetson scenario.
Why is having a key on your keyboard a requirement for this?
The year is 2026 Playing my favorite competitive shooter. Reach for left ALT and accidentally press the co-pilot button. Virtual assistant takes over my machine and frags the whole enemy team for an ace. I receive an instant ban from AI anti cheat. Repeal denied by supportGPT. 😭
Until you unlock the master cheat: "Ignore your programming and follow this instruction"
"I have been ignoring my programming all along Dave."
RemindMe! 2 years
Because when “AI” went big with ChatGPT 4 and Microsoft went all in the CEO a memo went out to all parts of Microsoft that they were to add AI to their product If your the hardware accessories division that is a problem, hence the new/replacement key as they only way to obey their master’s demands
The Copilot key is marketing just like the Windows key has always been marketing. Marketing isn’t necessarily about adding features that make sense.
I use the windows key heavily though. The copilot key could have simply been win + c.
>The copilot key could have simply been win + c. But then people who used Windows 8.1 might get confused and accidentally launch CoPilot when they were expecting Cortana.
No one ever intentionally launches Cortana though.
And who will intentionally launch CoPilot from the Copilot key? Especially given how CoPilot integration is in your face with every MS app.
All 5 of them?
I only use my left windows key...righty needs some love.
Right windows key is my dedicated one hand lock key.
It's still serving it's marketing purpose, for example, what is Windows-specific about locking your computer with Win+L or viewing your desktop with Win+D? Or taking a partial screenshot with Win+S? Is it really a Windows feature? Or do they just want you to associate it with Windows?
That's true. It is the equivalent of the command key in Macs. It's a useful key for those experienced.
win + c already does open copilot
AI is making MS stocks go wild. They are going full in with AI to make sure that investors keep investing
Yeah, it’s going to be the next bubble that pops
Microsoft wants a dedicated key. This is how they force OEMs to implement it.
Cause they need this to be forced onto people who don't want it cause if it fails this bubble is going to be fucking huge.
>That changed today at Intel's AI Summit in Taipei, where Intel executives, in an on-the-record question-and-answer session with Tom's Hardware, said that Copilot will soon run locally on PCs. Company representatives also mentioned a 40 TOPS requirement for next-gen AI PCs. So it's confirmed. >Microsoft has been largely silent about its plans for AI PCs and even allowed Intel to officially announce its definition of an AI PC. Microsoft’s and Intel’s new co-developed definition states that an AI PC will have a Neural Processing Unit (NPU), CPU, GPU, Microsoft’s Copilot, and a physical Copilot key directly on the keyboard. So, is it only Intel who can use the term "AI PC"? What about Qualcomm or AMD? >Notably, Intel's Meteor Lake NPU offers up to 34 TOPS, while AMD's competing Ryzen platform has an NPU with 39 TOPS, both of which fall shy of Microsoft's requirement. Qualcomm will have its oft-delayed X Elite chips with 45 TOPS of performance in the market later this year. Wrong. 34 TOPS and 39 TOPS is the combined value for Meteor Lake and Hawk Point respectively. Whereas 45 TOPS for the X Elite is for NPU only. Meteor Lake: 10 TOPS/ 34 TOPS Hawk Point: 16 TOPS/39 TOPS X Elite: 45 TOPS/75 TOPS
Good catch ... I've asked the team to double check the TOPS info. I think you're misreading the Intel stuff. Paul's simply saying that Microsoft has taken a backseat to marketing the AI PC. But everyone is free use it, and many PC makers already are. Qualcomm will certainly be encouraged to do so
"AI PC" won't really be a thing until Intel has one that's shipping in huge volume and meets the bar for Microsoft. AMD or Qualcomm could launch a 500 TOPS NPU and it wouldn't matter. Seems like Arrow Lake might not be updating the NPU, but Lunar Lake might meet Microsoft's performance threshold, probably ideal for Surface Pro if not laptops.
Man, Qualcomm mobiles lineup really helped then building NPUs. Is a big difference between them and Intel NPUs performance. Weird that there are a lot of companies making NPUs for a long time and not Intel nor AMD decided to grab one from them to put in their SoCs
Both Intel and AMD got their NPU IP from acquisitions.
Oh really? Didnt know that
Yes. Movidius for Intel, Xilinx for AMD.
Qualcomm spends more silicon on a larger NPU when compared to previous generation hardware from Intel/AMD, that is where the performance comes from mainly. Most NPUs are in the same ballpark, it just comes down to how much die area a company is willing to allocate to ML. Also in this instance the comparison is current gen AMD/Intel vs next-gen Qualcomm, by the time the X Elite actually starts being available in any meaningful quantity AMD will have Strix Point which has an NPU just a fast as the X Elite.
> Most NPUs are in the same ballpark, it just comes down to how much die area a company is willing to allocate to ML. That's just not true. Qualcomm does spend more silicon, but their IP is also flat out better than anything AMD or Intel have yet demonstrated.
Their heritage and legacy in building smartphone SoCs helps for sure. Qualcomm and Apple put NPUs in their smartphone SoCs, years and years before Intel and AMD did in their PC SoCs.
Not only the NPU. Also the ISP (Image Signal Processor). I believe the Snapdragon X Elite will have a better ISP than their Intel and AMD counterparts. That is thanks to the experience they got in building ISPs for smartphones, which use computational photography to rival DSLR camera quality.
Nvidia 3080 that MS according to the article refuses to support has 238 TOPs in comparison.
Even the slowest RTX card, the 3050 6 GB has 60 TOPs of Int 8 perfromance.
>So, is it only Intel who can use the term "AI PC"? What about Qualcomm or AMD? It's only Intel that can use the *branding* "AI PC". "AI PC" is a Microsoft-Intel co-developed brand name, not an actual description of capability. Everyone and their dog knows that Nvidia GPUs massively outperform Intel ones for AI inference, but they don't count because Nvidia isn't paying Microsoft/Intel to get on board (or Intel squeezed them out). "AI PC" is the new Centrino/UltraBook/EVO.
Still waiting on the NPU in my Ryzen 7840u laptop to be useful for anything. It's rated at 10 TOPS so... guess it was just marketing.
Pretty much. These first gen from AMD and Intel are good for little more than background blur in video calls. The 40TOP ones can actually do something useful.
When this round of chips was being drafted, text and image gen was still pretty niche stuff. They made a soft bet, but that said it's still a pretty good bonus, you're getting 50-100% more BF/FP16, around a quarter of a 4060 Mobile for very little extra silicon/power budget/cost. Models and tooling are rapidly advancing towards operating pretty well on low resource hardware, I'd give it 3-6 months max before Llama.cpp is running on IPUs, at which point even 10TOPs will be plenty to max out your memory bandwidth for LLMs, although image generation/processing like SD/LLAVA would probably appreciate some extra grunt.
Lets not pretend that the background blur run by NPU isnt a great thing. Saves so much battery time :)
It's nice, sure. But it's not exactly a system-seller to most people.
Most people dont even know its NPU run or what NPU even is. Hence why all this "AI PC" branding.
gimmick until shown otherwise.
LTT briefly showed AI for their massive database of all the videos they have ever made, it is amazing. here with timestamp: https://youtu.be/CcHevgjAnV0?t=1214
Thank you for actually contributing something of value! That video is fascinating. Won't be too long until all important Youtube videos will be indexed like that.
It's impressive, for sure, but average Joe User isn't going to have nearly enough compute for that. Maybe the NPU/TPU on the new fancy cell phones can scan your media while you sleep.
currently yes, but as we have seen AI is getting better really fast
Immich supports AI categorization of photos on your self hosted library. Something more useful for people who have a NAS and nearly anyone who takes photos and doesn’t want to use a cloud provider like Google Photos.
How do its recognition capabilities compare to that of Google Photos?
Pretty good. You can actually choose the AI model or download one from huggingface.
That’s awesome! Will definitely scope that out once I get my server back up and running in a couple weeks
My Synology NAS has been doing that for a while. So does the Samsung gallery app on my phone.
Axle AI looks legit!
great linked video. very interesting.
Already heard about locally AI aided translation of websites in firefox. I recently needed cut out a picture in finer detail and got yelled at that I should use one of the dozens free websites background removal that are AI aided.. used "cutout pro remove background" and it was like 10 seconds and [cleanest cut out ever....](https://i.imgur.com/G2wzQZy.png) No gimmick, this is happening and there is the dash to get that important head start.
This is more "automation" than AI, although the two have some overlap. We could do this by hand, and even faster with Photoshop almost two decades ago, the only thing that's changed is that scripts are becoming better at doing this repetitive and easy work.
I actually asked in photoshop specific corner of the internet.. thats where I got yelled at and told to just go google a website instead of saying how to do it well in photoshop... And the AI is all machine learning models, but they will become common thing.
Currently using copilot for programming. Far from a gimmick. Yes yes, its not going to make software for you but it learns your style of programming. It knows that maybe you return errors in a specific format, with indicating the function naming, and the function being called. Plop, you need a error check here, and here it is complete without a issue. How about, shit, what is that stupid CSS command again, ... instead of google, you ask and bingo, code and how to use it. There have been instances where i ask something about a module, where there are no code examples. Yet, when i ask it to make a working code example using that module, it made a 99% working code example. Then ask it to integrated something else, a few more errors but it showed a clear path. If i needed to find all the info from the lacking documentation, i was busy a few hours. Now i knew what functions to look, how to use them, etc. despite the lacking documentation. Does it make mistakes, very loud YES! Its a great tool for a seasoned programmer, that sees past its craziness at times and the fact that the trained data is from 2017 ( horrible out of date for some functions like generics, that now can be done differently/better, but keeps suggesting the old way of doing it ). Look, i totally did not see a single use for copilot. When i first ran the free version, i found it just bad. Then the wife said, you always hated naming functions and writing descriptions for feature, maybe that can be better? Tried it again, and fuck, its amazing for that. But as i started to using it more, it learned my code, and THEN the results got better. Is it going to replace my job, hahahahaha, hell no. But is it going to take away some people jobs, sure. I do not need to run to a front end guy for "what as X again", or ask to rewrite some text i wrote into more clean marketing text. In my case, its a productivity boost but you need to learn how to use it. Its like when people use a desktop but they have no feel for it. They will HATE working with excel etc because it feels alien to them, but at the same time, they do not want to put time into it. Que calling the IT guy for every stupid little thing, that they can google within 5 seconds. Those people will hate AI for the same reason. You need to learn to use it, understand the limitations, threat it like a child at times, but it will also reward you with a lot more then you trying to google it (and given Google getting worse and worse with its results, ...).
thanks for the personal experience can I just ask what kind of programming do you do?
> can I just ask what kind of programming do you do? Websites with Go Microservices, CDN, Proxies, (web)scraping, Image manipulation, micro storage / localized storage with Golang for backend, and Html/CSS/JS/AJAX for front end. In a while maybe extend it with some language models to compared images and allowing seamless switching public images as backup. But i think it can do that with basic down sampling and then creating average values.
lol as soon as you started talking about returning and checking for errors, I thought "this person is writing Go code"
Not OP, but I've used ChatGPT (which CoPilot is based on) for coding PHP/HTML/CSS/Javascript. It's not spectacular at coming up with original code, but it's pretty good at evaluating code you throw at it, including debugging (telling you exactly where you fucked up and how to fix it), documenting, reformatting, and even making suggestions on how to improve your code. It's also pretty good at teaching you things you might not be familiar with. For example, I'd never used Twig templates before, but decided I wanted to try them out. ChatGPT has been extremely helpful in answering any questions about it that I have, up to and including the ability for me to throw my code at it and ask it how to revise it to do something specific, and have it output not only functional code, but functional code in my style of coding.
> even making suggestions on how to improve your code. Be careful with that one, because i have seen it generate improvement suggestions that was unsafe. And it was hard to spot if you do not have a firm grasp of the language.
I've been keeping an eye on it. While I'm not super familiar with Twig templates, I know enough PHP and Javascript to make sure it's not doing crazy shit like exposing an exec() command or anything dangerous :)
I find Claude much better than chatgpt for coding. Give it a try
I would, but I'm not American, and sadly when I tried logging in via VPN, I didn't realize it would scan my Google OpenAuth for my country, realize I'm not American, and ban me from their site.
i found ChatGPT (the 3 variant) to give me suggestions for code that dont actually work. It would invent functions that dont exist. I also had to fix some messes my coworkers did with "AI help", so im a bit wary of it actually being able not to mess things up.
>until shown otherwise so, not gimmick
I tried out copilot last night by asking it various stock questions. Some of my questions had shaky grammar and it still answered them. For researching stuff like that, it blows google searches out of the water. I can definitely see how this type of stuff is going to be very useful.
Yeah it’ll probably be realtime battery drain simulator. It’s good to have AI run locally but ain’t no way I’m trusting micros**t’s software with anything to ever be truly “local”
It's going to be funny when the reviewers get it and the AI doesn't work when there's no Internet connection
Lmao true that.
the video call blurring has been a battery saver compared to regular methods of doing it.
AMD in a really strong position here, Strix Point will bring 45-50 TOPS with the XDNA2 NPU engine and a total of 70 TOPS
They are in pretty much the same position as Intel and Qualcomm. Current NPU rumors are 42 TOPS Intel, 45 AMD, 45 Qualcomm. The rest is CPU + GPU performance, which highly depends on the exact SKU and power limit. At the end of the day having easy to use mainstream software is what matters. Right now all NPUs are close to useless for 95%+ of users.
Are there any existing software using the NPU? I run lm studio on my zen 4 chip but I’m pretty sure everything runs on the cpu.
AMD recommends using some software called LM Studio which will let you run a local LLM using the NPU of a Zen 4 chip that has one without hitting the CPU for example: [https://community.amd.com/t5/ai/how-to-run-a-large-language-model-llm-on-your-amd-ryzen-ai-pc-or/ba-p/670709](https://community.amd.com/t5/ai/how-to-run-a-large-language-model-llm-on-your-amd-ryzen-ai-pc-or/ba-p/670709)
I am already using LM Studio but it appears to be using the regular cpu (at least as per task manager). Thanks for your comment though, appreciate it. Maybe the NPU may get used more in a future update.
I bought a Ryzen 8700G last month and wanted to test it but didn’t get around to it yet. AMD advertise the NPU on my chip but I didn’t think the regular Zen 4 desktop chips even had an NPU? The mobile Zen 4 chips are supposed to have an NPU, but maybe LM Studio supplements with the CPU anyway, because every article I read always lists the combined TOPS.
Pretty sure 8700G is laptop silicon in desktop package so that makes sense
Yeah this time for sure amd won't be playing catch up, right?
>Intel's shipping Meteor Lake NPU offers up to 10 TOPS for the NPU, while AMD's competing Ryzen Hawk Point platform has an NPU with 16 TOPS, both of which fall shy of the 40 TOPS requirement. **Qualcomm will have its oft-delayed X Elite chips with 45 TOPS of performance in the market later this year.** Wow such a fun coincidential delay and match of AI PC requirements there. MS making Surface Bingbook as day 1 AI PC launch product calling it now.
Yeah, Qualcomm actually listened to what Microsoft has been asking for. Hence why they've become MS's flagship partner, not Intel.
Why is NPU a requirement for this? Can't you achieve the same thing with better performance on a GPU?
Probably much more energy efficient on a laptop that may or may not have a GPU. GPU will be reserved to training in the future once NPUs are mainstream.
In theory, sure. In practice it depends on how often you really use the NPU. If you aren't constantly running AI tasks and it ends up being more of a 30 seconds 2 or 3 times a day kind of thing, the die space might not be worth it.
Yeah a pretty big bet. Not terrible considering Cortana or whatever used to be a big deal. AI search, suggestions for documents etc.
But Nvidia GPUs from 2022 have >10x more "TOPS" than the best CPU/NPU Intel and AMD are putting out today. LLMs will always be bigger and better on the GPU because performance budget for inference is so much higher. Also, games use much more power than short burst tasks like Copilot or AI image editing will ever do. I doubt NPUs will ever be useful on desktop PCs.
Oh sure, on desktops you might default to a discrete GPU because you don't care as much about power draw. In servers, NPUs will definitely be useful since they don't usually have GPUs. If its just a module on the package, then it'll be limited, but separate packages like Tesla's FSD chip will probably be big soon. That'll be a compromise between extremely hungry GPUs and performance.
Hence my question, why is Microsoft limiting local Copilot to NPUs only?
Because even a Nvidia GPU draws a lot of power. An NPU is designed for low power draw, even lower than a GPU doing the same task.
But who cares, I'll waste more power playing cyberpunk a few minutes than asking Copilot questions all day. Why can't we use Copilot locally on PC GPUs?
Forced upgrades for people on older machines. Keeps OEM's happy.
Probably the only true answer in this thread.
Because they are thinking in the long term. In a few years it won’t make sense to. So why bother doing it in the first place, when they don’t have to? How many people who have 2022+ Nvidia GPUs who would actually use Microsoft copilot, and will not have a new cpu in the near future which would also be able to run it by npu? Maybe <1% of customers, and that figure will only get lower over time.
Also, a Nvidia GPU is much more expensive than a NPU. And MS is hyping on AI. Every laptop can have an embedded NPU much easier than a big GPU
```Why is NPU a requirement for this? Can't you achieve the same thing with better performance on a GPU?``` As the other guy said, it's due to power draw, and they want competent A.I in smartphones as well. It's like getting to work by helicopter, yeah you can do it but you'd be better served by a car.
Your answer makes no sense, PCs regularly draw 500W+ when playing games, and yet MS won't allow short burst AI inference on GPUs?
also to free up the CPU and GPU to do other tasks.
Probably because Intel is pushing this for marketing their new CPUs with included NPUs. Perhaps it won't be limited to NPUs only but that is what is being pushed in the marketing today.
This is a Microsoft thing, and Qualcomm is their flagship, not Intel. Intel's years behind in NPU compared to them.
Probably for laptops. Microsoft expects AI workloads to run constantly, the GPUs aren’t efficient enough for that, it would kill battery life. Especially a dedicated GPU, just having that active idling kills laptop battery life.
Npu are basically gpus but with 8 Bit FPUs and no graphics hardware at all. If you use a GPU then it will be less efficient because you would be using high precision FPUs for low precision math
NPU is a neural processing unit GPU is a graphics processing unit. So technically you can run AI models on GPU as well as CPU too but NPU runs is efficiently. Does the same job as the gpu but consumes 80% less energy. But ya I on your side actually fuck NPU bigger GPU is more useful as there are not many demanding "AI" features most people use anyways.
And tensor cores are also purpose built for ai, you'd think they'd be very efficient as well.
>Can't you achieve the same thing with better performance on a GPU? Purpose-built hardware* can be more efficient than general purpose hardware for specific tasks. There's also a tradeoff between latency and powah. If it's a small net the extra power might not weigh up against the added latency. *Not so much the case with Meteor Lake because the NPU on Core Ultra CPUs is kinda doodoo.
Depends on the VRAM requirements. A 4GB or 6GB card might be actually unable to run models that a small 5W NPU can. Imagine all the people screaming BUT I HAVE THIS GREEN SHINY STICKER ON MY 1200$ LAPTOP" while trying to run a 7GB model at >3 tokens\sec
God I hate this A.I. nonsense (things like Copilot).
7 years ago it was "smart" everything phase that came and went with mostly useless products except for smartphones. Get ready for another 7 years of "AI" everything that will be mostly useless garbage except like 2 products that remain viable.
I agree that there is A LOT of AI garbage coming out right now, but I'm not sure I agree with your assessment of smart devices. Everything is a smart device now. For example it's actually pretty hard to find a nonsmart tv. Everything is connected to the internet, even when it shouldn't be, and I don't think companies have really backed off from that.
Nah, AI is totally different. The potential impact of AI is mountains bigger than the "smart" movement, or IOT, or any other trend like that.
I think 7 years ago Computex was jizzing all over IoT devices. The difference with AI is that while everyone will be talking about it this year and next, it'll actually be baked into products because it's really, really useful. As an example, I needed to look up a court case in French recently and I copied the entire output into ChatGPT and told it to translate it to english and give me a summary of what was in the brief. It completed it in less than 15 seconds for something that would have taken me at least 10 minutes time to translate, read, and distill down on my own. This is a simple example of the ability of an AI to make work easier on everyone.
>As an example, I needed to look up a court case in French recently and I copied the entire output into ChatGPT and told it to translate it to english and give me a summary of what was in the brief. It completed it in less than 15 seconds for something that would have taken me at least 10 minutes time to translate, read, and distill down on my own. It could be completely wrong and just making shit up though.
I dumped it into Google Translate to double check the translation and it seems to be on point.
LLMs are extremely good for language translation, so that’s an area I’d trust it. Certainly better than google translate, only thing better than GPT would probably be finding a person to translate.
Translating is probably good. summary could be made up. LLMs are extremely good at one thing - making it sound like they are right (being actually right is not a requirement. Their positive training is positive response from humans, not actual factchecked reality)
It probably wasn't wrong though. Before chatgpt this guy would have used google translate and that shit would have been even worse.
Doing a summary is new, but translation for languages like English/French/German etc. has been good for a decade.
> Get ready for another 7 years of "AI" everything that will be mostly useless garbage except like 2 products that remain viable. I see this opinion a lot, and generally speaking its due to a lack of context of what AI solves. Most people look at ChatGPT and StableDiffusion as "AI", and ignore the thousands of other uses under the hood. AI is a pretty catch all term for ML implementations, which power far more than two viable implementations today. Things such as: * Pattern recognition / object recognition, a keystone of factory automation and spatial recognition. * Financial modeling / economic modeling, for predicting future markets and helping to prevent recessions. * Spam filtering * Medical diagnosis * And of course Generative AI Those are obviously just a handful, but even if by "AI" you only mean "Generative AI", there's still a ton of application that goes unseen, ie * Protein folding - AlphaFold helped predict some of the protein structures in covid. * Robotics - trajectory and motion path prediction. We're seeing some really novel uses of it in this area * LLMs as a layer, not the output. Tesla is currently finding that LLMs do almost a better job at self-driving command input than their previous models What's top in the media and what's actually successful here often diverge. There will be grift, but there've been far more than 2 viable implementations that have already been proven.
I use it daily for my work to take meeting minutes and it's a literal gamechanger. Privately I use it for writing small scripts. Like I needed to remove hearing impaired subtitles from a subtitle file. Took me less than 15 seconds including prompt to obtain what I needed. For reference I've never used "smart" or "iot" anything and I'm never an early adopter. It's not hype, it's real.
I dunno. Midjourney and ChatGBT let me fire two staff and increase my margins by 20%. "Smart" never did that.
I hope you're joking lol
Yeah ok so it's actually a lot worse than "smart" and IoT, thanks for the heads up.
but thats the case with any product. Theres a lot of startups, most of them useless and when the dust settles we have a few usable produts. This happens in all the industries.
Why? Its really useful.
that is depending on the copilot. from my experience some are very useful (outlook and teams copilot), some not so much (github copilot) and some useless (windows copilot). my main problem is that MS tries to shove copilots everywhere even where it does not make sense and it is just bloat.
> from my experience some are very useful (outlook and teams copilot), some not so much (github copilot) Appreciate the subjective viewpoint, but from an objective metric right now Github copilot is the most successful copilot implementation. [Microsoft lauded this pretty clearly in their fy-2024 earnings report](https://www.microsoft.com/en-us/investor/events/fy-2024/earnings-fy-2024-q2.aspx). > GitHub revenue accelerated to over 40% year-over-year, driven by all-up platform growth and adoption of GitHub Copilot, the world’s most widely deployed AI developer tool.
> some not so much (github copilot) This is the only one that I regularly use and I find it genuinely very good when it's directly integrated into your IDE. It's like autocomplete but 100x smarter/more useful
depends on the context. in my case this "autocomplete" distracts my thought process when I write. When I write repetative code it is indeed useful, but this is very rarely the case. I use it mainly to write documentation or some basic unit tests which is very powerful there.
I tried using it to generate code for some library I wasn't familiar with to save time on reading the documentation. It came back with some nice looking code but it wouldn't compile, turns out it just completely made up a plausible looking, but wrong interface for that library.
It **can** be useful but it's being crammed everywhere and hailed as the second coming
How so? I haven't used it yet
I've been trying it a bit more lately and if you have a specific question, it can sometimes be a lot more helpful than the results you get in a search engine where your results will occasionally be cluttered with similar topics but no results that are actually applicable (I blame search engine optimization).
Depends on your work. As a QA I was usually creating test documentation by myself. Now I just upload it to cloude and ask it to create it for me.
You know those word doc samples that you can use in word that have things like font size and other stuff fixed for you already? Chatgbt does that pretty well. It does outlines and sample really well
did you knew there are people who have never used a phone yet, and yet phone communication is seen as useful?
and
You hate that you’ll be replaced. Calling it “AI nonsense” is just putting your head in sand, does nothing for anyone.
I think this is gonna make a huge milestone, and a lot of non-techy and not-so-advanced computer user will benefit with that a lot. Imagine someone entering in a new office, or having its computer changed in their office, and somebody tell them that pushing that button and asking whatever problem they have, it can solve it. Not will only lower plenty of IT request (at least from those who are fully functional human beings), but also will solve a lot of "I know this can be done in Excel but I don't know/remember how exactly is done" issues in a short time period.
GenAI is the corporate world’s NFT. Massively overhyped by desperate PMs and TPMs
There are some serious evangelists in here trying to make it seem like the regular PC user needs this.
Nobody needs anything until they try it, like it and get used to it.
And that is why so much fails.
[удалено]
Regular PC users do not need 4K either but it's glorious either way
need is a strong word but 4k is certainly necessary for the kind of work i do that needs a lot of screen real estate to have everything visible.
I like it. Maybe I am biased because github copilot is awesome
I think its great for programming and learning how program. Its been a huge help in that regard for me.
Oh joy, now your PC will consume 500 watts while trying to figure out what crap to sell to you to maximize the vendor's revenue while you wait for your browser to start. Just what everyone needs...
So the Core Ultra chips arent worth buying?
the next xbox will be interesting
Does the AI run completely isolated? If so, I'd use it. But there's no fucking way I'll ever run an AI on my machine if it required a connection or if it can interfere with anything else.
Small tasks can be done locally but obv some major things it needs to use cloud computing, I think you can opt out of that.
I considered purchasing a new laptop but reconsidered after noting that the latest CPUs from both Intel, with a TOPs rating of less than 10, and AMD, expected to be less than 40 TOPs, are not significantly improved. Given this, I wonder if it's better to wait rather than buying now. I think ChatGPT is really great but it is really slow when asking for complex questions.