CodepointIterator/src, branch master UTF-8 codepoint iterator class Redefined CodePoint utility masks as C++14 binary literals 2014-09-16T18:09:14+00:00 Adrian Kummerlaender 2014-09-16T18:09:14+00:00 31f8cbdd0b038c7196f630febd2bbe2f9183cde0 * they are more expressive as the shift-syntax in my opinion 
* they are more expressive as the shift-syntax in my opinion
Added static assert of std::string::value_type size 2014-04-16T17:53:00+00:00 Adrian Kummerländer 2014-04-16T17:53:00+00:00 c87d8ec91f0e191dba6b744788167bb8d41d339e * CodepointIterator only supports UTF-8 encoded single-byte input strings ** this should prevent CodepointIterator from compiling on systems with larger char sizes while providing a helpful error message * improved const-correctness by marking currByte (iterator dereferencing cache) and helper method arguments as const 
* CodepointIterator only supports UTF-8 encoded single-byte input strings
** this should prevent CodepointIterator from compiling on systems with larger char sizes while providing a helpful error message
* improved const-correctness by marking currByte (iterator dereferencing cache) and helper method arguments as const
Simplified bitmask utility functions 2014-04-11T18:48:11+00:00 Adrian Kummerländer 2014-04-11T18:48:11+00:00 98aade06e8960a4cd11e937089d64b42df982826 * they were relocated into a separate compilation unit by 79a65ce ** but I want them to be inlined which is hindered by exactly that ** i.e. the implementations are now moved to the utility header file and marked as inline * removed unnecessary declaration of arguments as reference 
* they were relocated into a separate compilation unit by 79a65ce
** but I want them to be inlined which is hindered by exactly that
** i.e. the implementations are now moved to the utility header file and marked as inline
* removed unnecessary declaration of arguments as reference
Added operator- member implementation and improved test cases 2014-04-10T18:26:20+00:00 Adrian Kummerländer 2014-04-10T18:26:20+00:00 c61de194f49c47880f8a886c88dcf044f893861a * operator- takes a reference to a const std::string::const_iterator and as such enables determining the actual position of a codepoint within a string * ranged for loops in test cases now take the iterator value by rvalue reference instead of by value 
* operator- takes a reference to a const std::string::const_iterator and as such enables determining the actual position of a codepoint within a string
* ranged for loops in test cases now take the iterator value by rvalue reference instead of by value
Switched to standard integer types 2014-04-09T16:31:44+00:00 Adrian Kummerländer 2014-04-09T16:31:44+00:00 572af7499d088a239d37e9dc09e5e7ac45c13d29 * i.e. replaced uint8_t with std::uint8_t contained within the standard namespace ** as this version of the types is defined by the standard this should offer better compiler independence and standard compliance * removed unnecessary pointer and reference type arguments in the std::iterator template specializations the CodepointIterator class is derived from 
* i.e. replaced uint8_t with std::uint8_t contained within the standard namespace
** as this version of the types is defined by the standard this should offer better compiler independence and standard compliance
* removed unnecessary pointer and reference type arguments in the std::iterator template specializations the CodepointIterator class is derived from
Removed internal codepoint caching 2014-02-15T11:57:50+00:00 Adrian Kummerländer 2014-02-15T11:57:50+00:00 d9dc09933635a62e188600c419fe42bcd03a3820 * it is not the responsibility of a codepoint iterator to cache the resolved codepoint for reuse ** if this is required by the user of this class can iterate it better in the context it is required ** e.g. implement a "CachedIterator" template 
* it is not the responsibility of a codepoint iterator to cache the resolved codepoint for reuse
** if this is required by the user of this class can iterate it better in the context it is required
** e.g. implement a "CachedIterator" template
Extracted helper functions and bitmasks into separate compilation unit 2014-02-15T11:48:35+00:00 Adrian Kummerländer 2014-02-15T11:48:35+00:00 79a65ce58ad8f3b2b1c9eeaba4b0b4710dc09e2c * utility.h and utility.cc now contain the UTF8-codepoint and unit bitmasks and read / write functions * Modified users of these functions and unions accordingly * Added the new compilation unit to the Makefile * Changed bitmask specification from plain integer literals to shift expressions for better readability 
* utility.h and utility.cc now contain the UTF8-codepoint and unit bitmasks and read / write functions
* Modified users of these functions and unions accordingly
* Added the new compilation unit to the Makefile
* Changed bitmask specification from plain integer literals to shift expressions for better readability
Initial commit 2013-10-05T10:41:07+00:00 Adrian Kummerländer 2013-10-05T10:41:07+00:00 4d1b9a918f8a189ba1e9887c6a9da04e7392db90 * CodepointIterator is a simple C++ iterator class which iterates through unicode codepoints in a UTF8-encoded string * It is derived from std::iterator and implements the std::bidirectional_iterator_tag * Dereferencing an instance of the class provides the codepoint as char32_t * Tests require Google Test and use UTF8-samples from http://www.columbia.edu/~fdc/utf8/ 
* CodepointIterator is a simple C++ iterator class which iterates through unicode codepoints in a UTF8-encoded string
* It is derived from std::iterator and implements the std::bidirectional_iterator_tag
* Dereferencing an instance of the class provides the codepoint as char32_t
* Tests require Google Test and use UTF8-samples from http://www.columbia.edu/~fdc/utf8/