I will discuss some recent work with Hanfeng Li in which we initiate a study of combinatorial independence in the context of sofic entropy. The project involves, among other things, ergodic theory on ultraproducts and applications to the Fuglede-Kadison determinant in group von Neumann algebras.