Optimization from Structured Samples for Coverage Functions

作者: Jialin Zhang , Xiaoming Sun , Wei Chen , Zhijie Zhang

DOI:

关键词:

摘要: We revisit the optimization from samples (OPS) model, which studies problem of optimizing objective functions directly sample data. Previous results showed that we cannot obtain a constant approximation ratio for maximum coverage using polynomially many independent form $\{S_i, f(S_i)\}_{i=1}^t$ (Balkanski et al., 2017), even if are $(1 - \epsilon)$-PMAC learnable these (Badanidiyuru 2012), means most function values can be approximately learned very well with high probability. In this work, to circumvent impossibility result OPS, propose stronger model called structured (OPSS) functions, where data encode structural information functions. show under three general assumptions on distributions, design efficient OPSS algorithms achieve problem. further prove lower bound assumptions, is tight when not considering computational efficiency. Moreover, also remove any one has no approximation.

参考文章(15)
Noam Nisan, Shahar Dobzinski, Tim Roughgarden, Ashwinkumar Badanidiyuru, Robert Kleinberg, Hu Fu, Sketching valuation functions symposium on discrete algorithms. pp. 1025- 1035 ,(2012) , 10.5555/2095116.2095197
G. L. Nemhauser, L. A. Wolsey, M. L. Fisher, An analysis of approximations for maximizing submodular set functions--I Mathematical Programming. ,vol. 14, pp. 265- 294 ,(1978) , 10.1007/BF01588971
Kumar Joag-Dev, Frank Proschan, Negative Association of Random Variables with Applications Annals of Statistics. ,vol. 11, pp. 286- 295 ,(1983) , 10.1214/AOS/1176346079
Henry W. Block, Thomas H. Savits, Moshe Shaked, Some Concepts of Negative Dependence Annals of Probability. ,vol. 10, pp. 765- 772 ,(1982) , 10.1214/AOP/1176993784
L. G. Valiant, A theory of the learnable symposium on the theory of computing. ,vol. 27, pp. 1134- 1142 ,(1984) , 10.1145/800057.808710
Maria-Florina Balcan, Nicholas J.A. Harvey, Learning submodular functions symposium on the theory of computing. pp. 793- 802 ,(2011) , 10.1145/1993636.1993741
Malay Ghosh, Multivariate negative dependence Communications in Statistics-theory and Methods. ,vol. 10, pp. 307- 337 ,(1981) , 10.1080/03610928108828041
Uriel Feige, Vahab S. Mirrokni, Jan Vondrák, Maximizing Non-monotone Submodular Functions SIAM Journal on Computing. ,vol. 40, pp. 1133- 1153 ,(2011) , 10.1137/090779346
Samuel Karlin, Yosef Rinott, Classes of orderings of measures and related correlation inequalities II. Multivariate reverse rule distributions Journal of Multivariate Analysis. ,vol. 10, pp. 499- 516 ,(1980) , 10.1016/0047-259X(80)90066-4