개발/연구
간단한 토크나이징
#define MAX_TOKEN_SIZE 125 int GetTokenList(char* Query, int TokenCount, char Delimiter, char RetResult[][MAX_TOKEN_SIZE]) { int iRet = 0; char *ptrI = NULL; char *ptrX = NULL; char *ptrC = Query; while ( ptrC ) { __try { ptrI = strchr(ptrC++, Delimiter); ptrX = ptrI ? strchr(ptrI+1, Delimiter) : NULL; if ( ptrI != NULL && ptrX != NULL ) iRet++; else break; if ( iRet > TokenCount ) break; String..
2011. 3. 24. 15:09
최근 댓글