Skip to content

Add Redis DSL connector#807

Open
huangguasky wants to merge 1 commit into
apache:masterfrom
huangguasky:feature/issue-799-redis-connector
Open

Add Redis DSL connector#807
huangguasky wants to merge 1 commit into
apache:masterfrom
huangguasky:feature/issue-799-redis-connector

Conversation

@huangguasky

Copy link
Copy Markdown

What changes were proposed in this pull request?

This PR adds a new Redis DSL connector module, geaflow-dsl-connector-redis. For issue #799:

The Redis connector supports:

  • Writing Redis string and hash data through RedisTableSink.
  • Reading Redis string and hash data through RedisTableSource.
  • Scanning Redis keys by pattern with the Redis SCAN command.
  • Registering the connector through SPI with connector type REDIS.

This PR also adds Redis connector configuration keys, CN/EN documentation with SQL examples, and unit tests based on jedis-mock. The connector reuses the existing Jedis dependency already managed by the project.

How was this PR tested?

  • Tests have Added for the changes
  • Production environment verified

Verified with:

mvn -pl geaflow-dsl/geaflow-dsl-connector/geaflow-dsl-connector-redis -am test -Dtest=RedisTableConnectorTest -Dsurefire.failIfNoSpecifiedTests=false -DskipITs

Fixes https://github.com/apache/geaflow/issues/799

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant