I was thinking since months to start a yoga course but I fear that in those lessons the "let's socialize" part is not considered a lot in comparison to the physical activity
Sure there's time to socialize. Waiting for class to start, walking to and from class/etc. You won't know until you try. (And if it doesn't work out then you'll still have done some yoga.)