TBH, if i where them i'd be trying to serve open source models from my own infra, much cheaper to pay per GPU's per hour and batch process all your users prompts, than leave that big 95% fat margins to OpenAI and Anthropic
But I guess they have customers who want those APIs anyways, idk, again, i thought they where a search service, not an ai company, so this sub for llms business deal is weird from that POV? like great that it works for them to get money/customers but that doesnt seem their main point of existing?
TBH, if i where them i'd be trying to serve open source models from my own infra, much cheaper to pay per GPU's per hour and batch process all your users prompts, than leave that big 95% fat margins to OpenAI and Anthropic
But I guess they have customers who want those APIs anyways, idk, again, i thought they where a search service, not an ai company, so this sub for llms business deal is weird from that POV? like great that it works for them to get money/customers but that doesnt seem their main point of existing?