Register a SA Forums Account here!
JOINING THE SA FORUMS WILL REMOVE THIS BIG AD, THE ANNOYING UNDERLINED ADS, AND STUPID INTERSTITIAL ADS!!!

You can: log in, read the tech support FAQ, or request your lost password. This dumb message (and those ads) will appear on every screen until you register! Get rid of this crap by registering your own SA Forums Account and joining roughly 150,000 Goons, for the one-time price of $9.95! We charge money because it costs us money per month for bills, and since we don't believe in showing ads to our users, we try to make the money back through forum registrations.
 
  • Post
  • Reply
in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

Kazinsal posted:

That's going to cause some interesting stall situations. Imagine you have 16 threads (as in pre-emptive multitasking execution threads, not simultaneous multithreading logical processors) that all want to access the AI accelerator and now need to schedule what order they each get to run their code in. Now you need to worry about saving/flushing/uploading/restoring state between each invocation, across each core, including situations where now you need to save and flush your thread's AI accelerator state to memory because there are 15 other threads ahead of you in the accelerator's work queue and you can't just idle because there's other non-accelerator-touching code to be executed.

I've not really been a fan of AVX because of the power/thermals/clock speed implications it has but losing 100 MHz on your all-core turbo when an AVX instruction enters the pipeline is preferable to having to completely re-juggle your scheduled threads in the event that one thread needs more linear time chugging away at a parallel vector math problem, because now processor X is hogging the AI accelerator and processors A through F are waiting for it to finish up and release the lock on the accelerator or process its job instead of just being able to do 8xFP64 FMAs in a normal ISA extension instruction that executes in series with the rest of the code. I suppose in an incredibly optimized environment it could have some excellent advantages because the CPU cores can be munching on some data returned from the AI accelerators in the integer/ALU path while they wait for their next AI job to be executed but since my low-level field of expertise is primarily in the memory/ALU space and not in the SIMD/vector space I'm not really sure what the difference is between this and an on-chip GPU that has no video output and only accepts compute shaders other than not having to deal with the overhead of needing to compile generic compute shader code to the shader cores' machine language.

(Disclaimer: I do not do kernel-level task scheduling algorithms for a living, just for fun. There are people who actually know more about this than I do and have written papers on it. I am just some dick who writes weird custom kernel poo poo for fun.)

Mainframe processors are extremely fucky and do weird things with pipelines, instructions, task scheduling, etc. with z/OS, so intuitive reasoning from 'normal' systems might not be that helpful. Mainframes are designed for I/O throughput so a thread (or lots of threads) waiting for output from an on-die 'peripheral' isn't an unusual or sub-optimal state. Conceptually, I do think it's sufficiently similar to CUDA, APUs or QuickSync.

Honestly, a 6 TF inferencer is not that impressive and seems more like a spec-sheet check-off so the few hundred middle-managers that buy these things can get approval for their next gen mainframe replacement to their CIO as "AI enabled."

Adbot
ADBOT LOVES YOU

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?

priznat posted:

Lol I was wondering what the ARM royalties are like for Apple, so they have fixed ones they have to re-up after x years or is it more fluid? They have got to be one of the biggest licensees of it.

Apple was one of the original investors in ARM and it wouldn’t surprise me if they got a perpetual platform license out of it.

movax
Aug 30, 2008

eschaton posted:

Apple was one of the original investors in ARM and it wouldn’t surprise me if they got a perpetual platform license out of it.

Yeah, I thought I remembered reading that they have one of the few perpetual / arch licenses. Otherwise I feel they would have started heading away from ARM already / not invested as much into developing their own ARM cores.

Hasturtium
May 19, 2020

And that year, for his birthday, he got six pink ping pong balls in a little pink backpack.
Just ordered an eight core Power9 combo from Raptor Computing yesterday, and 32GB of ECC RAM for it. It's currently on backorder, but I'll give it a month before I start getting antsy. Anyone have prior experience that's useful in getting started, or thoughts on the platform?

ConanTheLibrarian
Aug 13, 2004


dis buch is late
Fallen Rib
Looks like Apple isn't the only producer of super-wide ARM processors.

https://twitter.com/aschilling/status/1466436451361603596

https://twitter.com/aschilling/status/1466436457699201024

This pic in particular is interesting. The design is the opposite of Epyc's, a big compute die surrounded by many IO dies. That must be much better for inter-core latency.

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug
Yeah but is Amazon actually ever going to release it to Market outside of having to go through AWS?

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

Hah, never.

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

I’m sure you’ll be able to get one in an outpost.

ewe2
Jul 1, 2009

I have the guts of a 90's Alphastation 200 4/233 2 cpus with 256 ram. It was in fairly bad physical shape when I got it, and I had no way of powering it up due to its rather odd configuration. So I took the decision to dismantle it and save the pieces which I still have. It was the administration server for the Computer Science faculty of the University of Melbourne in the mid-90's and clearly they just put it out to pasture and upgraded to better hardware/more modern OS since it was running Digital Unix 3.2c. The FDDI interface seems to have given them no end of trouble, always going down and the ethernet interface never had enough bandwidth and the network setup was complicated since they had all their students work via NFS linked. Fascinating historical document.

I also have the obligatory SGI O2 but the CD doesn't work and I do need to replace the CMOS battery, that's going kaput but IRIX CDE is a nice environment, pity that the hardware is so underpowered.

NewFatMike
Jun 11, 2015

Not sure where else I would put this, but this is insanely cool:

https://youtu.be/ZAu3sXXCZuo

Mofabio
May 15, 2003
(y - mx)*(1/(inf))*(PV/RT)*(2.718)*(V/I)
I have a question. Does anyone know of any electronic computers that stored and processed number in ways not integer or float? I don't mean software systems, like the complicated ways CAS's store and calculate number, or ASCII digits, I mean like pre- or non-IEEE 754.

Phobeste
Apr 9, 2006

never, like, count out Touchdown Tom, man

Mofabio posted:

I have a question. Does anyone know of any electronic computers that stored and processed number in ways not integer or float? I don't mean software systems, like the complicated ways CAS's store and calculate number, or ASCII digits, I mean like pre- or non-IEEE 754.

Does this count? http://www.6502.org/users/dieter/bcd2/bcd2_6.htm Or like a 1s-complement system?

Mofabio
May 15, 2003
(y - mx)*(1/(inf))*(PV/RT)*(2.718)*(V/I)

Phobeste posted:

Does this count? http://www.6502.org/users/dieter/bcd2/bcd2_6.htm Or like a 1s-complement system?

Sure! So the adder is doing native BCD, staying in base-10 rather than going base-10 input -> base-2 for calculation -> base-10 output?

I guess I was imagining alternative or exotic number systems. One alternative but common number system example is coin-exchange, where each coin is in fixed fraction with another coin, and they can be combined to make any number (roman numerals are another example of these, where VII is 7 and not 511). These systems aren't generally practical for multiplication, and they aren't one-to-one with integer (roman numerals specifically have ordering and subtraction rules to make it so VII is the valid representation, and not IVI or IIV, but coins are orderless), so my guess is there hasn't been an IC like this, specifically. But I bring it up as an example of what I was thinking: non-integer and non-float number systems.

Mofabio fucked around with this message at 00:26 on Jan 2, 2022

BobHoward
Feb 13, 2012

The only thing white people deserve is a bullet to their empty skull
I don't think you're going to find any commercial computers which implement exotic number systems in hardware. Most are nightmarish to implement and nearly all have zero practical value, so why?

Phobeste posted:

Does this count? http://www.6502.org/users/dieter/bcd2/bcd2_6.htm Or like a 1s-complement system?

By the way, IBM is still big on decimal math right up to this day. They threw their weight around enough to get decimal FP formats into IEEE 754-2008, and POWER9 supports decimal in several places.

A lot of the demand for decimal math is related to IBM's mainstay for big computers, finance. There are tons of trivial and important decimal fractions which cannot be expressed in a finite number of binary digits. (0.1 base 10 = 0.0001100110011001100... binary). Accountants like it better when the computer's results are an exact match to what they'd see with old school manual computations. Most companies have regarded software implementation of decimal fractions as good enough to support such applications, but not IBM.

Pham Nuwen
Oct 30, 2010



Mofabio posted:

Sure! So the adder is doing native BCD, staying in base-10 rather than going base-10 input -> base-2 for calculation -> base-10 output?

I guess I was imagining alternative or exotic number systems. One alternative but common number system example is coin-exchange, where each coin is in fixed fraction with another coin, and they can be combined to make any number (roman numerals are another example of these, where VII is 7 and not 511). These systems aren't generally practical for multiplication, and they aren't one-to-one with integer (roman numerals specifically have ordering and subtraction rules to make it so VII is the valid representation, and not IVI or IIV, but coins are orderless), so my guess is there hasn't been an IC like this, specifically. But I bring it up as an example of what I was thinking: non-integer and non-float number systems.

Maybe look into British business computing prior to the decimal changeover? e.g. https://en.wikipedia.org/wiki/%C2%A3sd#Computing

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?
doing it in hardware is how you get the massive amount of bandwidth needed for the transaction processing loads mainframes handle

a guy who I chat with on Twitter sometimes has been doing IBM’s free online mainframe courses and has shared some of the insane stuff they have now, like not just parity or error correction for RAM but straight up RAID-style hot-swapping

carry on then
Jul 10, 2010

by VideoGames

(and can't post for 10 years!)

eschaton posted:

doing it in hardware is how you get the massive amount of bandwidth needed for the transaction processing loads mainframes handle

a guy who I chat with on Twitter sometimes has been doing IBM’s free online mainframe courses and has shared some of the insane stuff they have now, like not just parity or error correction for RAM but straight up RAID-style hot-swapping

z systems have some wild capabilities. Parallel Sysplex, firmware-level hypervisor (to enable LPARs), hardware zip compression.

mdxi
Mar 13, 2006

to JERK OFF is to be close to GOD... only with SPURTING

carry on then posted:

z systems have some wild capabilities. Parallel Sysplex, firmware-level hypervisor (to enable LPARs), hardware zip compression.

LPARs well predate the Z series. I believe they were introduced all the way back with System/370, but they were definitely available on ES/9000 systems under MVS. That's where I started my career. Also available at that time: hot-swappable CPUs.

A decade later when I started working for Google I recognized their datacenter design (arbitrarily large collections of "ordinary" machines, any of which are allowed to fail at any time) as the inverse of IBM big iron (singular machines capable of terrific throughput, which are not allowed to fail under any circumstance).

Edit: if you never worked with true mainframes, the scale of what they were capable of is kinda hard to realize. In 1998, when your "average" PC had just graduated to 8MB of system RAM, I was using IBM Hiperspaces at work. This was a technique that let you read 2GB chunks of data from mass storage, and shove all those records through your batch processing flow, completely in-memory, before writing them back out to storage after processing.

mdxi fucked around with this message at 20:24 on Jan 3, 2022

carry on then
Jul 10, 2010

by VideoGames

(and can't post for 10 years!)

mdxi posted:

LPARs well predate the Z series. I believe they were introduced all the way back with System/370, but they were definitely available on ES/9000 systems under MVS. That's where I started my career. Also available at that time: hot-swappable CPUs.

A decade later when I started working for Google I recognized their datacenter design (arbitrarily large collections of "ordinary" machines, any of which are allowed to fail at any time) as the inverse of IBM big iron (singular machines capable of terrific throughput, which are not allowed to fail under any circumstance).

Edit: if you never worked with true mainframes, the scale of what they were capable of is kinda hard to realize. In 1998, when your "average" PC had just graduated to 8MB of system RAM, I was using IBM Hiperspaces at work. This was a technique that let you read 2GB chunks of data from mass storage, and shove all those records through your batch processing flow, completely in-memory, before writing them back out to storage after processing.

Well yeah they came earlier than z, but z is just a name. It's all the same lineage.

Modern z systems are still pretty drat huge, and since it's all a vertical platform the Systems division gets to experiment with some interesting architectural decisions. The next generation is playing around with cache design: https://www.anandtech.com/show/16924/did-ibm-just-preview-the-future-of-caches. No idea if it's going to work but it's pretty out there.

kaschei
Oct 25, 2005

Mofabio posted:

I have a question. Does anyone know of any electronic computers that stored and processed number in ways not integer or float? I don't mean software systems, like the complicated ways CAS's store and calculate number, or ASCII digits, I mean like pre- or non-IEEE 754.

Setun was a balanced ternary digital computer.

There are electronic analog computers where the computed value is proportional to the voltage in a circuit.

Hasturtium
May 19, 2020

And that year, for his birthday, he got six pink ping pong balls in a little pink backpack.
I know nobody’s kicked this thread in a while, but I fell down a bit of a YouTube wormhole learning a bit about PA-RISC. Anybody have thoughts or impressions? Of all the machines I used in college computer labs or friend’s eBay-harvested collections, they’re one I never managed to run into.

Hasturtium fucked around with this message at 06:55 on Feb 12, 2022

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug

Hasturtium posted:

I know nobody’s kicked this thread in a while, but I fell down a bit of a YouTube wormhole learning a bit about PA-RISC. Anybody have thoughts or impressions? Of all the machines I ran into in college computer labs or friend’s eBay-harvested collections, they’re one I never managed to run into.

I have one of these on top of my rack, came with several boxes of accessories, manuals, etc.

feedmegin
Jul 30, 2008

Hasturtium posted:

I know nobody’s kicked this thread in a while, but I fell down a bit of a YouTube wormhole learning a bit about PA-RISC. Anybody have thoughts or impressions? Of all the machines I ran into in college computer labs or friend’s eBay-harvested collections, they’re one I never managed to run into.

The stack and the heap grow in the opposite direction to normal, that's the main 'weird' thing I remember about it. They also did the same thing Itanium later did (which HP co-developed) of having massive by the standards of the time caches to make up for so-so performance.

You want really weird, try https://en.wikipedia.org/wiki/HP_FOCUS - stack architecture!

As for hardware hypervisors and indeed LPARs, an AIX server will also do those just fine, it's not just a mainframe thing.

feedmegin fucked around with this message at 13:00 on Feb 11, 2022

Pham Nuwen
Oct 30, 2010



I loaned a PA-RISC system to a friend in college and he never returned it... I'm still slightly salty about that.

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.
This thread reminded me I had been keeping an eye out for the BeagleV Risc-V SBC, but looks like it got cancelled :sigh:

Any other Risc-V Pi-alikes coming out?

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug

priznat posted:

This thread reminded me I had been keeping an eye out for the BeagleV Risc-V SBC, but looks like it got cancelled :sigh:

Any other Risc-V Pi-alikes coming out?

I think it got spun off:

https://www.techradar.com/news/a-risc-v-raspberry-pi-rival-is-about-to-hit-the-market

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.

Oh very cool. I'll keep an eye out for that one now!

Hasturtium
May 19, 2020

And that year, for his birthday, he got six pink ping pong balls in a little pink backpack.
I still want to see a Power Microwatt SoC, but god only knows when that’ll happen. Also vaguely bummed that Sifive is stopping production on the Hifive Unmatched. The CPU performance was underwhelming, but I still wanted to play around with a brand new ecosystem. And still waiting, since September, for my Raptor Computing Blackbird kit.

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug
Will say I'm a little disappointed Nvidia won't get their hands on ARM's IP. That would've been exciting, monopoly aside.

in a well actually
Jan 26, 2011

dude, you gotta end it on the rhyme

I mean, they already can/do license pretty much any (non-competitor) IP arm has? $60 billion buys a lot of ip licenses even at a 2% retail royalty rate.

They wouldn’t be able to use any of the parter-proprietary ip even if they did acquire them.

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.
It’s interesting as a lot of SoCs are moving away from Arm to Risc-V, I imagine the sale falling through may slow it down a little bit as Arm may be more willing to get competitive with licensing fees?

I don’t think the trend will stop though. Nvidia/arm would have been a solid combo both for enterprise and for consumer stuff. Now I wonder if nvidia joins the risc -v train even!

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug

priznat posted:

It’s interesting as a lot of SoCs are moving away from Arm to Risc-V, I imagine the sale falling through may slow it down a little bit as Arm may be more willing to get competitive with licensing fees?

I don’t think the trend will stop though. Nvidia/arm would have been a solid combo both for enterprise and for consumer stuff. Now I wonder if nvidia joins the risc -v train even!

Is it? Honestly most SoCs I see for embedded stuff remain ARM and ARM still has a significant advantage in power consumption. I could be wrong.

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.

CommieGIR posted:

Is it? Honestly most SoCs I see for embedded stuff remain ARM and ARM still has a significant advantage in power consumption. I could be wrong.

Well, it's fairly anecdotal I suppose but I know of a couple fairly major players going that way. And from talking to JTAG probe vendors they're seeing a lot of risc-v adoption happening. It won't be total but it's definitely going to take a bite out of Arm's business.

Kazinsal
Dec 13, 2011



I have made a terrible, awful, wonderful mistake.

feedmegin
Jul 30, 2008

priznat posted:

It’s interesting as a lot of SoCs are moving away from Arm to Risc-V, I imagine the sale falling through may slow it down a little bit as Arm may be more willing to get competitive with licensing fees?

I think some SoC vendors and other members of the ecosystem are talking about it specifically to get better deals out of ARM. I don't think there's any kind of seismic shift actually happening. Same as how 32-bit ARM servers were constantly touted as the future a few years ago because that got datacentres better rates out of Intel. Then everyone actually making them, e.g. Cavium, went bust because noone was actually buying it.

An NVidia acquisition would possibly have changed this, because NVidia+ARM is direct competition that makes its own silicon in a way that ARM now specifically is not. You don't want your competitor owning your architecture; ARM has got where it has by being conspicuously neutral.

feedmegin fucked around with this message at 15:23 on Feb 12, 2022

CommieGIR
Aug 22, 2006

The blue glow is a feature, not a bug


Pillbug

feedmegin posted:

I think some SoC vendors and other members of the ecosystem are talking about it specifically to get better deals out of ARM. I don't think there's any kind of seismic shift actually happening. Same as how 32-bit ARM servers were constantly touted as the future a few years ago because that got datacentres better rates out of Intel. Then everyone actually making them, e.g. Cavium, went bust because noone was actually buying it.

An NVidia acquisition would possibly have changed this, because NVidia+ARM is direct competition that makes its own silicon in a way that ARM now specifically is not. You don't want your competitor owning your architecture; ARM has got where it has by being conspicuously neutral.

I'm still pissed AMD and Intel dropped their Hybrid x86-64/ARM CPU plans. That could've been gamechanging.

movax
Aug 30, 2008

priznat posted:

It’s interesting as a lot of SoCs are moving away from Arm to Risc-V, I imagine the sale falling through may slow it down a little bit as Arm may be more willing to get competitive with licensing fees?

I don’t think the trend will stop though. Nvidia/arm would have been a solid combo both for enterprise and for consumer stuff. Now I wonder if nvidia joins the risc -v train even!

The Falcon (embedded GPU control processor / security stuff) is RISC-V I’m pretty sure. For Tegra and friends though, they have the perpetual ARM architecture license still, right?

priznat
Jul 7, 2009

Let's get drunk and kiss each other all night.

movax posted:

The Falcon (embedded GPU control processor / security stuff) is RISC-V I’m pretty sure. For Tegra and friends though, they have the perpetual ARM architecture license still, right?

I don’t know how the nvidia licensing works, but I would imagine they have a pretty solid relationship, so probably not moving away anytime soon. Especially with all the mellanox stuff being deeply intertwined with arm.

For SoCs anything that isn’t requiring datapath processing will be great to move to risc-v. That’s most of what I’m familiar with.. Anything moving from a MIPS32 would be great on a risc-v!

eschaton
Mar 7, 2007

Don't you just hate when you wind up in a store with people who are in a socioeconomic class that is pretty obviously about two levels lower than your own?

Kazinsal posted:

I have made a terrible, awful, wonderful mistake.



Congratulations! You can run Ultrix and BSD and VMS! It’ll run VMS pretty nicely, too.

Adbot
ADBOT LOVES YOU

feedmegin
Jul 30, 2008

priznat posted:

For SoCs anything that isn’t requiring datapath processing will be great to move to risc-v. That’s most of what I’m familiar with.. Anything moving from a MIPS32 would be great on a risc-v!

Surely anything moving from a MIPS32 is on an ARM already, by now. Certainly that's been the case multiple places I've worked.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply