C
CK
Guest
Hi, as discussed in case 00357638 all metadata cache files are created using 755 linux file privileges. This is fine if all JVM instances are running under the same OS user or if default settings are used for schemaMap (default is $HOME/progress/cassandra/...) creating the . But as soon as this is a fixed schemaMap dir is used with different OS users, only one user is able to access the metadata chache files. For other users exceptions are thrown due to missing file access privileges to metadata cache files. This problem occurs e.g. when the driver is used with Spark in yarn-client mode. In this execution mode the Spark driver process runs under the submitting user id, whereas all Spark executor JVMs are running under the yarn user id. And hence the fixed schemaMap does no longer work. Suggestion: Add new JDBC property schemaMapUMask Setting schemaMapUMask=775 will allow users of the same group to share metadata cache files. Thanks for considering, Christian
Continue reading...
Continue reading...