• 1 Post
  • 115 Comments
Joined 2 年前
cake
Cake day: 2023年6月12日

help-circle



  • Well, I work at an AI hyperscaler. I can tell you how much my facility uses, and how much each rack uses, but don’t have any way to determine what the customer is doing on that server. Or even which servers a given customer is using. Is it being used heavily for queries? How many? Of what kind? We don’t know. Only what the rack/row/pod/hall is consuming.

    Also, does the network gear overhead count? How do you apportion that?

    We have no visibility into the customer workload. Some of our customers use our systems for scientific research. Drugs, etc. How do you tally that?

    I’m not saying that it is impossible, just that if the customer won’t pay for that report, we’re not going to spend money to build the systems to produce it.

    Do I agree? No. But I’m just a grunt.
















  • So, a lot of our AI customers have no real use for LLM. It’s pharmaceutical and genetics companies looking for the treatments and cures for things like pancreatic cancer and Parkinson’s.

    It is a big problem to paint all generative AI with the “stealing IP” brush.

    It seems likely to me that an AI may be the only controller that can handle all of the rapidly changing parameters needed to maintain a safe fusion process. Yes it needs safeties. But it needs research, too.

    I urge much more consideration of the specific uses of this new technology. I agree that IP theft is bad. Let’s target the bad parts carefully.