Hey there Nir,
That’s a great question!
Based on what I could come up with after querying one of my boards with a Vote column, it seems like you should be able to get the Vote values from items, even including the users who have cast the vote. Here’s what I’m seeing on my end:
I’m sure you are already making more complex queries than I am, but here’s what I’ve used to get the result above:
In that case, you can also see which of the users within your account have voted for a particular item. For example,  stands for my user ID. Does that make sense?
There was also a similar question asked here. I recommend checking the community topics, in general, to find out if your questions have been answered already. Then, you can get the solutions you need faster