Hey there @Shinny and @vishwajeets
That’s a great question! It is currently not possible to retrieve a specific column by name, or ID, and I would indeed recommend querying all of the board data and then filtering the specific values you need in your application logic instead. I hope that helps. 
EDIT: I stand corrected - please check @mitchell.hudson 's post just below my own that provides a working API query example that can look up column values based on column ID.
-Alex