KServe is a nice serving solution that has incorporated technologies from many areas. IBM and Bloomberg have made many of the contributions, especially lately.